00000001:02000400:0.0F:1788791275.991119:0:2965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788791300.512974:0:3188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1788791302.596577:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 539 MB/s 00000001:01000000:1.0:1788791302.846988:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 583 MB/s 00000001:01000000:2.0:1788791303.100449:0:3250:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3007 MB/s 00000020:02000000:3.0F:1788791303.971582:0:3281:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_82_gfdb2c0c 00000400:02000000:2.0:1788791304.896914:0:3296:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.129@tcp [8/256/0/180] 00008000:02000000:0.0:1788791309.096294:0:3445:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788791364.788495:0:5248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788791376.404617:0:5818:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788791376.404621:0:5818:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788791376.404763:0:5818:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000562070e2 00000080:02000400:3.0:1788791376.404773:0:5818:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788791376.412569:0:5818:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788791376.412584:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788791376.412627:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000099750736) 00000020:00000080:3.0:1788791376.415810:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788791376.469556:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788791376.470744:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788791376.516540:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788791376.516584:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788791376.516606:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788791376.516653:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788791376.516678:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788791376.517283:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788791376.517292:0:5818:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788791376.517302:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a322985 00000020:01000004:3.0:1788791376.517441:0:5818:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788791376.517447:0:5818:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788791376.517452:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000562070e2 from MGS 00000020:01000004:3.0:1788791376.517456:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788791376.517467:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000002c890818) 00000020:00000080:3.0:1788791376.517476:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788791376.517546:0:5818:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000562070e2 from MGS, refs=2 00080000:01000000:3.0:1788791376.517552:0:5818:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788791376.517558:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a322993 00000100:00100000:3.0:1788791376.517651:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788791376.517803:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788791376.517808:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788791376.518811:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788791376.518820:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788791376.520001:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788791376.520516:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788791376.520528:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788791376.521490:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788791376.521500:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788791376.521837:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788791376.521843:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788791376.522860:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791376.522864:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791376.522866:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791376.523709:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791376.523712:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791376.523714:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791376.524630:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788791376.526694:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788791376.773510:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1631 MB/s 00000001:01000000:2.0:1788791377.024555:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2398 MB/s 00000001:01000000:2.0:1788791377.277580:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 600 MB/s 00000001:01000000:2.0:1788791377.536244:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 396 MB/s 00080000:10000000:3.0:1788791377.559567:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1788791377.576221:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788791377.593978:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788791377.594006:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788791377.594009:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788791377.605519:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788791377.605626:0:5818:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788791377.605693:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788791377.605982:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788791377.606011:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788791377.606544:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788791377.606703:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788791377.606709:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788791377.610604:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788791377.610617:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788791377.612986:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788791377.612999:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788791377.613811:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788791377.613832:0:5818:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.129@tcp' 00000020:01000004:1.0:1788791377.613834:0:5818:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788791377.613881:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.129@tcp (typ=mgc) 00000020:00000080:1.0:1788791377.613901:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.129@tcp (00000000f72d0f63) 00000020:00000080:1.0:1788791377.613917:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788791377.614038:0:5818:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ecbab74f@MGC192.168.201.129@tcp: add connection 192.168.201.129@tcp at head 00010000:00010000:1.0:1788791377.614242:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.129@tcp-0 is initialized 00000040:01000000:1.0:1788791377.614249:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788791377.615434:0:5833:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788791377.618065:0:5834:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788791377.618115:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.129@tcp (uuid 9967ad2d-016f-4163-8b2b-d5dc380f4403) 00000020:00000080:3.0:1788791377.618175:0:5818:0:(genops.c:1385:class_connect()) connect: client 9967ad2d-016f-4163-8b2b-d5dc380f4403, cookie 0xcd6380150a3229a1 00000100:00080000:3.0:1788791377.618187:0:5818:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788791377.618192:0:5818:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import 00000000ecbab74f using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788791377.618235:0:5818:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000093663a32 x1875683630383232/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788791377.618260:0:5818:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 9967ad2d-016f-4163-8b2b-d5dc380f4403->MGS 00000020:01000004:3.0:1788791377.618277:0:5818:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788791377.618282:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788791377.618306:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000000d94cdaa) 00000020:00000080:3.0:1788791377.618318:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788791377.620983:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000093663a32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9967ad2d-016f-4163-8b2b-d5dc380f4403:3311:1875683630383232:0@lo:250: 00000100:00100000:0.0:1788791377.621083:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791377.624209:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630383232 00000100:00100000:2.0:1788791377.624224:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630383232 00000100:00100000:2.0:1788791377.624274:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791377.624281:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0652842 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3311:x1875683630383232:12345-0@lo:250: 00010000:00080000:2.0:1788791377.624378:0:5831:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9967ad2d-016f-4163-8b2b-d5dc380f4403@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:2.0:1788791377.624417:0:5831:0:(genops.c:1385:class_connect()) connect: client 9967ad2d-016f-4163-8b2b-d5dc380f4403, cookie 0xcd6380150a3229af 00000100:00080000:2.0:1788791377.624541:0:5831:0:(import.c:65:import_set_state_nolock()) 00000000a80d9f30 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788791377.624619:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0652842 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+5:3311:x1875683630383232:12345-0@lo:250: Request processed in 337us (3535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791377.624626:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788791377.624727:0:3311:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788791377.624748:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.129@tcp: connect to target with instance 0 00000100:00080000:1.0:1788791377.624759:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788791377.624770:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788791377.624773:0:3311:0:(import.c:65:import_set_state_nolock()) 00000000ecbab74f MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788791377.624776:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788791377.624790:0:3311:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788791377.624796:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000093663a32 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9967ad2d-016f-4163-8b2b-d5dc380f4403:3311:1875683630383232:0@lo:250: 00000100:00100000:3.0:1788791377.630487:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788791377.630698:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788791377.630706:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788791377.633797:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788791377.633812:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788791377.650771:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788791377.650787:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788791377.656455:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788791377.656639:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788791377.656645:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788791377.658821:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788791377.658835:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788791377.729006:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788791377.729782:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788791377.729789:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788791377.734839:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788791377.734857:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788791377.735647:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788791377.735832:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788791377.735843:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788791377.739378:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788791377.739396:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788791377.744594:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788791377.744793:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788791377.744799:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788791377.746115:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788791377.746410:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788791377.747377:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788791377.747586:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788791377.747592:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788791377.748488:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788791377.748497:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788791377.808684:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788791377.808925:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788791377.808932:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788791377.815001:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788791377.815016:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788791377.815784:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788791377.815792:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788791377.819480:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788791377.819508:0:5818:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788791377.819513:0:5818:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788791377.819634:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788791377.819672:0:5818:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788791377.819677:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788791377.819678:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788791377.819679:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791377.819680:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791377.819682:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791377.819683:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791377.819684:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788791377.819686:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788791377.819687:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788791377.819688:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788791377.819690:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791377.819691:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788791377.819694:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788791377.819696:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788791377.819697:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788791377.819699:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791377.819700:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791377.819705:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791377.819706:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791377.819707:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788791377.819708:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788791377.819709:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788791377.819710:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788791377.819710:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791377.819711:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788791377.819766:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788791377.819784:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001e52ec51 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630383360:0@lo:253: 00000100:00100000:1.0:1788791377.820693:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791377.820786:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c456d403 going to sleep for 11 seconds 00000100:00100000:2.0:1788791377.820901:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630383360 00000100:00100000:2.0:1788791377.820910:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630383360 00000100:00100000:2.0:1788791377.820990:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788791377.821001:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000300488a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+5:5818:x1875683630383360:12345-0@lo:253: 20000000:01000000:2.0:1788791377.821076:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788791377.821079:0:5832:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788791377.821583:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788791377.821646:0:5832:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788791377.821950:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788791377.823492:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788791377.830648:0:5832:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788791377.830657:0:5832:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788791377.830664:0:5832:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788791377.830667:0:5832:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788791377.830683:0:5832:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788791377.831431:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788791377.831673:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788791377.831688:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788791377.831750:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788791377.831800:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788791377.833489:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788791377.833920:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788791377.833936:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788791377.834007:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788791377.834017:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788791377.834250:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788791377.834261:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788791377.834298:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788791377.834350:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788791377.834389:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788791377.834395:0:5832:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788791377.834409:0:5832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788791377.834776:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788791377.834789:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788791377.834913:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788791377.834956:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788791377.835003:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788791377.835015:0:5832:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788791377.835257:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788791377.835267:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788791377.835313:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788791377.835352:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788791377.835388:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788791377.835399:0:5832:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788791377.835481:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788791377.835490:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788791377.835616:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788791377.835659:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788791377.835923:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788791377.835975:0:5832:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788791377.835983:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788791377.836791:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788791377.837441:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788791377.837469:0:5832:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.129@tcp for mdt 20000000:01000000:3.0:1788791377.837471:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.129@tcp (null) (null) (null) 00000040:00080000:3.0:1788791377.837504:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788791377.837512:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788791377.837812:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788791377.837902:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.129@tcp (null) (null) 00000040:00080000:3.0:1788791377.837978:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788791377.837991:0:5832:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788791377.838026:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788791377.838449:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788791377.838717:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788791377.838721:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788791377.838735:0:5832:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788791377.838747:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788791377.838750:0:5832:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788791377.838779:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788791377.838782:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788791377.839456:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788791377.839758:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788791377.839802:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788791377.839924:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1788791377.839938:0:5832:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788791377.839941:0:5832:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788791377.840632:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788791377.840976:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788791377.841015:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788791377.841406:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:3.0:1788791377.841425:0:5832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788791377.841428:0:5832:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788791377.841433:0:5832:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788791377.841435:0:5832:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788791377.841441:0:5832:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788791377.841458:0:5832:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788791377.841805:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788791377.842018:0:5832:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788791377.851477:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788791377.851534:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788791377.851608:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788791377.851634:0:5832:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788791377.851653:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000034de116a/0xcd6380150a3229b6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791377.851674:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000034de116a/0xcd6380150a3229b6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791377.851683:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000034de116a/0xcd6380150a3229b6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791377.851689:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000034de116a/0xcd6380150a3229b6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791377.851695:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000034de116a/0xcd6380150a3229b6 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791377.851702:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000034de116a/0xcd6380150a3229b6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791377.851707:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000034de116a already unused, calling callback (00000000f9a42674) 00010000:00010000:2.0:1788791377.851710:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000034de116a/0xcd6380150a3229b6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791377.851716:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000034de116a/0xcd6380150a3229b6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791377.851739:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000034de116a/0xcd6380150a3229b6 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791377.851745:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000034de116a/0xcd6380150a3229b6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791377.851750:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000034de116a/0xcd6380150a3229b6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788791377.851774:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788791378.148615:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000300488a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+5:5818:x1875683630383360:12345-0@lo:253: Request processed in 327608us (327917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791378.148636:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788791378.148760:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001e52ec51 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630383360:0@lo:253: 10000000:01000000:1.0:1788791378.148776:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788791378.148779:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788791378.148781:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788791378.148783:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788791378.148784:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788791378.148785:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788791378.148787:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788791378.148788:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788791378.148789:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788791378.148790:0:5818:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788791378.148791:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788791378.148793:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788791378.148810:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000562070e2 from lustre-MDT0000 10000000:01000000:1.0:1788791378.148848:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788791378.148852:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788791378.148856:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9aba88c60000 10000000:01000000:1.0:1788791378.148860:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788791378.148866:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9aba88c60000 from 1 10000000:01000000:1.0:1788791378.148869:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788791378.148926:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000a18603c3/0xcd6380150a3229bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.148937:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000a18603c3/0xcd6380150a3229bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.148952:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000a18603c3/0xcd6380150a3229bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791378.148970:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000119d5e9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630383488:0@lo:101: 00000100:00100000:1.0:1788791378.149007:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791378.149693:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000036ec0fcd going to sleep for 11 seconds 00000100:00100000:2.0:1788791378.149696:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630383488 00000100:00100000:2.0:1788791378.149703:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630383488 00000100:00100000:2.0:1788791378.149759:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788791378.149767:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063a4446d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+5:5818:x1875683630383488:12345-0@lo:101: 00010000:00010000:2.0:1788791378.149780:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791378.149793:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000034de116a/0xcd6380150a3229c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a3229bd expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.149816:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000034de116a/0xcd6380150a3229c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a3229bd expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.149826:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000034de116a/0xcd6380150a3229c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a3229bd expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.149835:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000034de116a, rc 0) 00000100:00100000:2.0:1788791378.149885:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063a4446d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+6:5818:x1875683630383488:12345-0@lo:101: Request processed in 118us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791378.149891:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788791378.149910:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000119d5e9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630383488:0@lo:101: 00010000:00010000:1.0:1788791378.149922:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000a18603c3/0xcd6380150a3229bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3229c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.149931:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000a18603c3/0xcd6380150a3229bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a3229c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791378.149981:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000119d5e9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630383616:0@lo:501: 00000100:00100000:1.0:1788791378.150007:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791378.150035:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000036ec0fcd going to sleep for 11 seconds 00000100:00100000:0.0:1788791378.150086:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630383616 00000100:00100000:0.0:1788791378.150091:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630383616 00000100:00100000:0.0:1788791378.150168:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788791378.150184:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a042fc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+6:5818:x1875683630383616:12345-0@lo:501: 00000100:00100000:0.0:1788791378.150399:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a042fc3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+6:5818:x1875683630383616:12345-0@lo:501: Request processed in 224us (390us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788791378.150406:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788791378.150542:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000119d5e9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630383616:0@lo:501: 10000000:01000000:1.0:1788791378.150568:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788791378.150586:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000a18603c3/0xcd6380150a3229bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3229c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.150594:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 00000000a18603c3/0xcd6380150a3229bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3229c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791378.150602:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9aba98e4f000 10000000:01000000:1.0:1788791378.150607:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788791378.150617:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9aba98e4f000 10000000:01000000:1.0:1788791378.150619:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788791378.150622:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9aba98e4f000 from 1 10000000:01000000:1.0:1788791378.150624:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788791378.150643:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000fc89524d/0xcd6380150a3229cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.150650:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000fc89524d/0xcd6380150a3229cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.150658:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000fc89524d/0xcd6380150a3229cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791378.150670:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000119d5e9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630383744:0@lo:101: 00000100:00100000:1.0:1788791378.150698:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791378.150744:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000036ec0fcd going to sleep for 11 seconds 00000100:00100000:3.0:1788791378.150811:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630383744 00000100:00100000:3.0:1788791378.150897:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630383744 00000100:00100000:3.0:1788791378.150934:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788791378.150940:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c072a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+6:5818:x1875683630383744:12345-0@lo:101: 00010000:00010000:3.0:1788791378.150948:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791378.150960:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000048e22e66/0xcd6380150a3229d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a3229cb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791378.150976:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000048e22e66/0xcd6380150a3229d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a3229cb expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791378.150984:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000048e22e66/0xcd6380150a3229d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a3229cb expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791378.150992:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000048e22e66, rc 0) 00000100:00100000:3.0:1788791378.151054:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c072a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+7:5818:x1875683630383744:12345-0@lo:101: Request processed in 114us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791378.151061:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788791378.151167:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000119d5e9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630383744:0@lo:101: 00010000:00010000:1.0:1788791378.151247:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000fc89524d/0xcd6380150a3229cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3229d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.151255:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000fc89524d/0xcd6380150a3229cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a3229d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791378.151271:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788791378.151285:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000fc89524d/0xcd6380150a3229cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3229d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.151291:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 00000000fc89524d/0xcd6380150a3229cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3229d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791378.151309:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788791378.151312:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788791378.151316:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9aba98e4f000 10000000:01000000:1.0:1788791378.151318:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788791378.151321:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788791378.151323:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788791378.151338:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 000000003ff1c7f1/0xcd6380150a3229d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.151344:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 000000003ff1c7f1/0xcd6380150a3229d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.151350:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 000000003ff1c7f1/0xcd6380150a3229d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791378.151361:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000119d5e9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630383872:0@lo:101: 00000100:00100000:1.0:1788791378.151385:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791378.151414:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000036ec0fcd going to sleep for 11 seconds 00000100:00100000:3.0:1788791378.151465:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630383872 00000100:00100000:3.0:1788791378.151469:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630383872 00000100:00100000:3.0:1788791378.151501:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788791378.151508:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eac847fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+7:5818:x1875683630383872:12345-0@lo:101: 00010000:00010000:3.0:1788791378.151516:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791378.151523:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a3254aa1/0xcd6380150a3229e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a3229d9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791378.151546:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a3254aa1/0xcd6380150a3229e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a3229d9 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791378.151554:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a3254aa1/0xcd6380150a3229e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a3229d9 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791378.151560:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a3254aa1, rc 0) 00000100:00100000:3.0:1788791378.151589:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eac847fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+8:5818:x1875683630383872:12345-0@lo:101: Request processed in 82us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791378.151594:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788791378.151690:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000119d5e9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630383872:0@lo:101: 00010000:00010000:1.0:1788791378.151700:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 000000003ff1c7f1/0xcd6380150a3229d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3229e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.151706:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 000000003ff1c7f1/0xcd6380150a3229d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a3229e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791378.151761:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000119d5e9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630384000:0@lo:501: 00000100:00100000:1.0:1788791378.151785:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791378.151812:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000036ec0fcd going to sleep for 11 seconds 00000100:00100000:0.0:1788791378.151958:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630384000 00000100:00100000:0.0:1788791378.151963:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630384000 00000100:00100000:0.0:1788791378.151997:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788791378.152005:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb5f302b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+8:5818:x1875683630384000:12345-0@lo:501: 00000100:00100000:0.0:1788791378.152381:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb5f302b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+9:5818:x1875683630384000:12345-0@lo:501: Request processed in 378us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791378.152388:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788791378.152444:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000119d5e9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630384000:0@lo:501: 00000100:00100000:2.0:1788791378.152489:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004106943 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630384128:0@lo:503: 00000100:00100000:2.0:1788791378.152526:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791378.152557:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3ecfa44 going to sleep for 11 seconds 00000100:00100000:3.0:1788791378.152613:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630384128 00000100:00100000:3.0:1788791378.152618:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630384128 00000100:00100000:3.0:1788791378.152649:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788791378.152656:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000151d6b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+9:5818:x1875683630384128:12345-0@lo:503: 00000100:00100000:3.0:1788791378.152814:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000151d6b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+9:5818:x1875683630384128:12345-0@lo:503: Request processed in 158us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791378.152900:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788791378.152933:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004106943 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630384128:0@lo:503: 00000100:00100000:0.0:1788791378.153910:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000927b61aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:5860:1875683630384256:0@lo:502: 00000100:00100000:0.0:1788791378.153958:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791378.153996:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 00000000027e78c5 going to sleep for 11 seconds 00000100:00100000:1.0:1788791378.154067:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630384256 00000100:00100000:1.0:1788791378.154073:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630384256 00000100:00100000:1.0:1788791378.154120:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788791378.154154:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000fa43597 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+9:5860:x1875683630384256:12345-0@lo:502: 00000100:00100000:1.0:1788791378.154418:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000fa43597 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+9:5860:x1875683630384256:12345-0@lo:502: Request processed in 292us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791378.154425:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788791378.154517:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000927b61aa pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:5860:1875683630384256:0@lo:502: 00000020:01000000:0.0:1788791378.154542:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791378.154551:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791378.154553:0:5860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788791378.154558:0:5860:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788791378.154561:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788791378.154582:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000b48ce3fb) 00000020:00000080:0.0:1788791378.154601:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788791378.154607:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788791378.154690:0:5860:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788791378.154698:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a3229ee 00000020:00000080:0.0:1788791378.155014:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788791378.155018:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791378.155022:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791378.155023:0:5860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788791378.155026:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791378.155029:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791378.155030:0:5860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788791378.155033:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788791378.155039:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000eadd08ea) 00000020:00000080:0.0:1788791378.155049:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788791378.155053:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788791378.155054:0:5860:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788791378.155057:0:5860:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788791378.155062:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788791378.155105:0:5860:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000562070e2 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788791378.155115:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000005ad57bac) 00000020:00000080:0.0:1788791378.155124:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788791378.155299:0:5860:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788791378.155305:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd6380150a322a03 00000020:00000080:0.0:1788791378.155393:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788791378.155398:0:5860:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788791378.155402:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcd6380150a322a0a 00080000:01000000:0.0:1788791378.155406:0:5860:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788791378.155409:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a322a11 00080000:10000000:0.0:1788791378.155803:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788791378.157413:0:5860:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788791378.160025:0:5860:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788791378.276310:0:5860:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788791378.276773:0:5860:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788791378.283273:0:5860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788791378.283596:0:5860:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788791378.342124:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b64a6a25) 00000020:00000080:2.0:1788791378.342184:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788791378.342244:0:5860:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788791378.342250:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a322a1f 00000020:00000080:2.0:1788791378.344520:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788791378.346099:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788791378.406664:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788791378.437799:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788791378.465211:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788791378.498456:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788791378.526098:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788791378.554004:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcd6380150a322a26 00000020:00000080:3.0:1788791378.554652:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788791378.554665:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791378.554672:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791378.554674:0:5860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788791378.554677:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791378.554681:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791378.554683:0:5860:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788791378.554686:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788791378.554687:0:5860:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788791378.554690:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791378.554699:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791378.554700:0:5860:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788791378.554703:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791378.554708:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791378.554709:0:5860:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788791378.554723:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788791378.554764:0:5860:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788791378.554824:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000057e9331c pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:5860:1875683630384384:0@lo:502: 00000100:00100000:3.0:1788791378.554902:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791378.554961:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c9660416 going to sleep for 11 seconds 00000100:00100000:0.0:1788791378.555118:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630384384 00000100:00100000:0.0:1788791378.555153:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630384384 00000100:00100000:0.0:1788791378.555195:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788791378.555204:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050b05615 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+9:5860:x1875683630384384:12345-0@lo:502: 00000100:00100000:0.0:1788791378.555623:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050b05615 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+9:5860:x1875683630384384:12345-0@lo:502: Request processed in 420us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791378.555632:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788791378.555760:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000057e9331c pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:5860:1875683630384384:0@lo:502: 00000020:01000000:1.0:1788791378.555788:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788791378.555793:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791378.555795:0:5860:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788791378.555799:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788791378.555976:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788791378.555997:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788791378.556109:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 000000003ff1c7f1/0xcd6380150a3229d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3229e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.556120:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 000000003ff1c7f1/0xcd6380150a3229d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3229e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791378.556156:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9aba98e4f000 from 1 10000000:01000000:2.0:1788791378.556159:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788791378.556189:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000b9e2d874/0xcd6380150a322a2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.556197:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000b9e2d874/0xcd6380150a322a2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.556206:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000b9e2d874/0xcd6380150a322a2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791378.556232:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004106943 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630384512:0@lo:101: 00000100:00100000:2.0:1788791378.556265:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791378.556290:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000005e949f7e going to sleep for 11 seconds 00000100:00100000:1.0:1788791378.556367:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630384512 00000100:00100000:1.0:1788791378.556373:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630384512 00000100:00100000:1.0:1788791378.556406:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788791378.556414:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abacb14d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+9:5818:x1875683630384512:12345-0@lo:101: 00010000:00010000:1.0:1788791378.556423:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791378.556436:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000aa94e730/0xcd6380150a322a34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322a2d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.556455:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000aa94e730/0xcd6380150a322a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322a2d expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.556464:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000aa94e730/0xcd6380150a322a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322a2d expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.556471:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000aa94e730, rc 0) 00000100:00100000:1.0:1788791378.556508:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abacb14d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+10:5818:x1875683630384512:12345-0@lo:101: Request processed in 95us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791378.556515:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788791378.556635:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004106943 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630384512:0@lo:101: 00010000:00010000:2.0:1788791378.556647:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000b9e2d874/0xcd6380150a322a2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322a34 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.556654:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000b9e2d874/0xcd6380150a322a2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322a34 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791378.557361:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004106943 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630384640:0@lo:256: 00000100:00100000:2.0:1788791378.557400:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791378.557476:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000005e949f7e going to sleep for 11 seconds 00000100:00100000:0.0:1788791378.557569:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630384640 00000100:00100000:0.0:1788791378.557575:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630384640 00000100:00100000:0.0:1788791378.557641:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788791378.557649:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa1c13f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+10:5818:x1875683630384640:12345-0@lo:256: 20000000:01000000:0.0:1788791378.557664:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788791378.557669:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788791378.557755:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa1c13f3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+10:5818:x1875683630384640:12345-0@lo:256: Request processed in 107us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791378.557762:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788791378.557826:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004106943 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630384640:0@lo:256: 10000000:01000000:2.0:1788791378.558401:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788791378.558421:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000b9e2d874/0xcd6380150a322a2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322a34 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.558430:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 00000000b9e2d874/0xcd6380150a322a2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322a34 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791378.558438:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9aba98e4f000 from 1 10000000:01000000:2.0:1788791378.558440:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788791378.558465:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 000000004c75a09b/0xcd6380150a322a3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.558472:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 000000004c75a09b/0xcd6380150a322a3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.558487:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 000000004c75a09b/0xcd6380150a322a3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791378.558500:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000004106943 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630384768:0@lo:101: 00000100:00100000:2.0:1788791378.558534:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791378.558932:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000005e949f7e going to sleep for 11 seconds 00000100:00100000:1.0:1788791378.558988:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630384768 00000100:00100000:1.0:1788791378.558993:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630384768 00000100:00100000:1.0:1788791378.559020:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788791378.559086:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbc80712 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+10:5818:x1875683630384768:12345-0@lo:101: 00010000:00010000:1.0:1788791378.559096:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791378.559108:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f9c018a3/0xcd6380150a322a42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322a3b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.559197:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f9c018a3/0xcd6380150a322a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322a3b expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.559209:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f9c018a3/0xcd6380150a322a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322a3b expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.559216:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f9c018a3, rc 0) 00000100:00100000:2.0:1788791378.559488:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbc80712 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:5818:x1875683630384768:12345-0@lo:101: Request processed in 403us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791378.559494:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788791378.559558:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000004106943 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630384768:0@lo:101: 00010000:00010000:0.0:1788791378.559573:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 000000004c75a09b/0xcd6380150a322a3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322a42 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791378.559594:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 000000004c75a09b/0xcd6380150a322a3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322a42 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791378.559653:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000927b61aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630384896:0@lo:501: 00000100:00100000:0.0:1788791378.559682:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791378.559754:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ce7bb9b going to sleep for 11 seconds 00000100:00100000:2.0:1788791378.559821:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630384896 00000100:00100000:2.0:1788791378.559826:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630384896 00000100:00100000:2.0:1788791378.559887:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788791378.559894:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0073dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:5818:x1875683630384896:12345-0@lo:501: 00000100:00100000:2.0:1788791378.560497:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0073dc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:5818:x1875683630384896:12345-0@lo:501: Request processed in 603us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791378.560504:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788791378.560573:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000927b61aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630384896:0@lo:501: 00000100:00100000:0.0:1788791378.560603:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000927b61aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630385024:0@lo:503: 00000100:00100000:0.0:1788791378.560642:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791378.560799:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ce7bb9b going to sleep for 11 seconds 00000100:00100000:3.0:1788791378.560846:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630385024 00000100:00100000:3.0:1788791378.560851:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630385024 00000100:00100000:3.0:1788791378.560874:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788791378.560879:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000041b402a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:5818:x1875683630385024:12345-0@lo:503: 00000040:00080000:3.0:1788791378.560911:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788791378.560953:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000041b402a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:5818:x1875683630385024:12345-0@lo:503: Request processed in 74us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791378.560959:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788791378.561095:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000927b61aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630385024:0@lo:503: 00000040:00080000:3.0:1788791378.562011:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788791378.562254:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788791378.562274:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788791378.562290:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 000000004c75a09b/0xcd6380150a322a3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322a42 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.562300:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 000000004c75a09b/0xcd6380150a322a3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322a42 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791378.562339:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788791378.562341:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9aba98e4f000 10000000:01000000:1.0:1788791378.562344:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9aba98e4f000 10000000:01000000:1.0:1788791378.562347:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788791378.562363:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9aba98e4f000 from 1 10000000:01000000:1.0:1788791378.562366:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788791378.562394:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 0000000067a230e8/0xcd6380150a322a49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.562402:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 0000000067a230e8/0xcd6380150a322a49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.562411:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 0000000067a230e8/0xcd6380150a322a49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791378.562426:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a8831ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630385152:0@lo:101: 00000100:00100000:1.0:1788791378.562467:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791378.562493:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000006e9956d8 going to sleep for 11 seconds 00000100:00100000:3.0:1788791378.562547:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630385152 00000100:00100000:3.0:1788791378.562552:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630385152 00000100:00100000:3.0:1788791378.562576:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788791378.562583:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000478724dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:5818:x1875683630385152:12345-0@lo:101: 00010000:00010000:3.0:1788791378.562592:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791378.562602:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007f057279/0xcd6380150a322a50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322a49 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791378.562621:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007f057279/0xcd6380150a322a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322a49 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791378.562639:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007f057279/0xcd6380150a322a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322a49 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791378.562647:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007f057279, rc 0) 00000100:00100000:3.0:1788791378.562727:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000478724dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5818:x1875683630385152:12345-0@lo:101: Request processed in 143us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791378.562733:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788791378.562954:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a8831ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630385152:0@lo:101: 00010000:00010000:1.0:1788791378.562968:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 0000000067a230e8/0xcd6380150a322a49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322a50 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791378.562975:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 0000000067a230e8/0xcd6380150a322a49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322a50 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791378.563022:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a8831ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630385280:0@lo:501: 00000100:00100000:1.0:1788791378.563123:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791378.563393:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000006e9956d8 going to sleep for 11 seconds 00000100:00100000:3.0:1788791378.563432:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630385280 00000100:00100000:3.0:1788791378.563437:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630385280 00000100:00100000:3.0:1788791378.563501:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788791378.563508:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de3dd993 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5818:x1875683630385280:12345-0@lo:501: 00000100:00100000:3.0:1788791378.563765:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de3dd993 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5818:x1875683630385280:12345-0@lo:501: Request processed in 257us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791378.563776:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788791378.563843:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a8831ae pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630385280:0@lo:501: 00000100:00100000:0.0:1788791378.563875:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000927b61aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630385408:0@lo:503: 00000100:00100000:0.0:1788791378.563916:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791378.563991:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000000ce7bb9b going to sleep for 11 seconds 00000100:00100000:2.0:1788791378.564111:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630385408 00000100:00100000:2.0:1788791378.564117:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630385408 00000100:00100000:2.0:1788791378.564163:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788791378.564169:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006253f8b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5818:x1875683630385408:12345-0@lo:503: 00000100:00100000:2.0:1788791378.564512:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006253f8b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5818:x1875683630385408:12345-0@lo:503: Request processed in 342us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791378.564519:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788791378.564625:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000927b61aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630385408:0@lo:503: 00000100:00100000:2.0:1788791378.564941:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000333b7834 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:5865:1875683630385536:0@lo:502: 00000100:00100000:2.0:1788791378.564977:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791378.565007:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f819bef1 going to sleep for 11 seconds 00000100:00100000:0.0:1788791378.565123:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630385536 00000100:00100000:0.0:1788791378.565151:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630385536 00000100:00100000:0.0:1788791378.565178:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788791378.565183:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007aabdb0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5865:x1875683630385536:12345-0@lo:502: 00000100:00100000:0.0:1788791378.565371:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007aabdb0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5865:x1875683630385536:12345-0@lo:502: Request processed in 187us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791378.565378:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788791378.565463:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000333b7834 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:5865:1875683630385536:0@lo:502: 00000020:01000004:2.0:1788791378.565510:0:5865:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788791378.565523:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000000498b726) 00000020:00000080:2.0:1788791378.565540:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788791378.565618:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000562070e2 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788791378.565622:0:5865:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000562070e2 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788791378.565624:0:5865:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000562070e2 4 00010000:00080000:2.0:1788791378.565650:0:5865:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009e068783@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1788791378.567624:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788791378.567853:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788791378.567883:0:5865:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788791378.567893:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcd6380150a322a5e 00000100:00080000:2.0:1788791378.567902:0:5865:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788791378.567907:0:5865:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009e068783 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788791378.567937:0:5865:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000333b7834 x1875683630385664/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788791378.567962:0:5865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788791378.568098:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000333b7834 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875683630385664:0@lo:38: 00000100:00100000:1.0:1788791378.568194:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791378.569868:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630385664 00000100:00100000:2.0:1788791378.569880:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630385664 00000100:00100000:2.0:1788791378.569918:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791378.569925:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a341b2ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875683630385664:12345-0@lo:38: 00000100:00100000:2.0:1788791378.570007:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a341b2ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875683630385664:12345-0@lo:38: Request processed in 81us (1812us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788791378.570014:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791378.570074:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788791378.570083:0:3311:0:(import.c:65:import_set_state_nolock()) 000000009e068783 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788791378.570087:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788791378.570090:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000333b7834 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875683630385664:0@lo:38: 00000100:00100000:2.0:1788791378.570694:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000333b7834 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:5865:1875683630385792:0@lo:502: 00000100:00100000:2.0:1788791378.570757:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791378.570789:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630385792 00000100:00100000:2.0:1788791378.570793:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630385792 00000100:00100000:2.0:1788791378.570822:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788791378.570830:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e260600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5865:x1875683630385792:12345-0@lo:502: 00000100:00100000:2.0:1788791378.571117:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e260600 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5865:x1875683630385792:12345-0@lo:502: Request processed in 287us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791378.571151:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788791378.571198:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c2fc1c0b going to sleep for 11 seconds 00000100:00100000:2.0:1788791378.571214:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000333b7834 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:5865:1875683630385792:0@lo:502: 00000040:00080000:2.0:1788791378.571239:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788791378.571486:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788791378.571508:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788791378.571528:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 0000000067a230e8/0xcd6380150a322a49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322a50 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791378.571539:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 0000000067a230e8/0xcd6380150a322a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322a50 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788791378.571583:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788791378.571585:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788791378.571586:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791378.571587:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791378.571588:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791378.571590:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791378.571591:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788791378.571592:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788791378.571594:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788791378.571595:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788791378.571597:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791378.571598:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788791378.571602:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788791378.571604:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788791378.571605:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788791378.571606:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791378.571607:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791378.571608:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791378.571609:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791378.571609:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788791378.571610:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788791378.571611:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788791378.571612:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788791378.571612:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791378.571613:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788791378.571629:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788791378.571640:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000927b61aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630385920:0@lo:253: 00000100:00100000:0.0:1788791378.571674:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791378.571695:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b9e47d40 going to sleep for 11 seconds 00000100:00100000:2.0:1788791378.571767:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630385920 00000100:00100000:2.0:1788791378.571773:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630385920 00000100:00100000:2.0:1788791378.571807:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788791378.571813:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebfec4f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5818:x1875683630385920:12345-0@lo:253: 20000000:01000000:2.0:1788791378.571830:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788791378.571844:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:3.0:1788791378.596197:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1788791378.609172:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788791378.609188:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788791378.609252:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788791378.609257:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788791378.609277:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a65 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791378.609296:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000aa94e730/0xcd6380150a322a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322a2d expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791378.609303:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a65 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791378.609343:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000aa94e730/0xcd6380150a322a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322a2d expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791378.609376:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000aa94e730/0xcd6380150a322a34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322a2d expref: 12 pid: 5830 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791378.609390:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000227e22d1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875683630386048:0@lo:104: 00000100:00100000:3.0:1788791378.609459:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791378.609518:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b9713bf going to sleep for 11 seconds 00000100:00100000:2.0:1788791378.609868:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630386048 00000100:00100000:2.0:1788791378.609876:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630386048 00000100:00100000:2.0:1788791378.609923:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791378.609931:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdb7542e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:5853:x1875683630386048:12345-0@lo:104: 00010000:00010000:2.0:1788791378.609943:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: 00000000b9e2d874/0xcd6380150a322a2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322a34 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.610013:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788791378.610031:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdb7542e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:5853:x1875683630386048:12345-0@lo:104: Request processed in 90us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791378.610039:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788791378.610063:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791378.610069:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: 00000000b9e2d874/0xcd6380150a322a2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322a34 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.610076:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b9e2d874 already unused, calling callback (000000000e7501d4) 10000000:00010000:2.0:1788791378.610080:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: 00000000b9e2d874/0xcd6380150a322a2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322a34 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.610087:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: 00000000b9e2d874/0xcd6380150a322a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322a34 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791378.610093:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: 00000000b9e2d874/0xcd6380150a322a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322a34 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791378.610099:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788791378.610155:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: 00000000b9e2d874/0xcd6380150a322a2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322a34 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.610161:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791378.610185:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: 00000000b9e2d874/0xcd6380150a322a2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322a34 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.610191:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: 00000000b9e2d874/0xcd6380150a322a2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322a34 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.610217:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791378.610218:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791378.610220:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791378.610266:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788791378.610277:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000333b7834 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630386176:0@lo:103: 00000100:00100000:2.0:1788791378.610310:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791378.610343:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630386176 00000100:00100000:2.0:1788791378.610348:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630386176 00010000:00010000:2.0:1788791378.610364:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000aa94e730/0xcd6380150a322a34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322a2d expref: 13 pid: 5830 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791378.610386:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791378.610392:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096b25d32 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:3312:x1875683630386176:12345-0@lo:103: 00010000:00010000:2.0:1788791378.610401:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791378.610406:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000aa94e730/0xcd6380150a322a34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322a2d expref: 13 pid: 5830 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.610416:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000aa94e730/0xcd6380150a322a34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322a2d expref: 13 pid: 5830 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.610431:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a65 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.610439:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a65 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788791378.610451:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001194913s 00010000:00010000:2.0:1788791378.610454:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a65 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.610471:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a65 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.610478:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a65 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.610483:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a65 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.610488:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ad9f596e already unused, calling callback (00000000f9a42674) 00010000:00010000:2.0:1788791378.610491:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a65 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.610497:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a65 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.610505:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a65 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791378.610515:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791378.610543:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096b25d32 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:3312:x1875683630386176:12345-0@lo:103: Request processed in 152us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791378.610550:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791378.610587:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000333b7834 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630386176:0@lo:103: 00010000:00010000:3.0:1788791378.610802:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000aa94e730/0xcd6380150a322a34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322a2d expref: 12 pid: 5830 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791378.610813:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000227e22d1 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875683630386048:0@lo:104: 00010000:00010000:3.0:1788791378.610826:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a65 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791378.610834:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a65 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791378.610838:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a65 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791378.610844:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a65 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791378.615849:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebfec4f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:5818:x1875683630385920:12345-0@lo:253: Request processed in 44030us (44168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791378.615863:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788791378.615944:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000927b61aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:5818:1875683630385920:0@lo:253: 10000000:01000000:2.0:1788791378.615959:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788791378.615962:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788791378.615964:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788791378.615965:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788791378.615978:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788791378.615979:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788791378.615980:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788791378.615982:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788791378.615983:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788791378.615985:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788791378.615986:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788791378.615987:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788791378.615989:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788791378.616002:0:5818:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788791378.619374:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788791378.619682:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788791378.627256:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788791378.627445:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788791378.627665:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788791378.627835:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788791378.629694:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788791378.629892:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788791378.630366:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788791378.630545:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788791378.630739:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788791378.630900:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1788791378.698391:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788791378.742410:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788791378.742660:0:5870:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788791378.742664:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788791378.742745:0:5871:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788791378.745949:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788791378.746457:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788791378.746920:0:5818:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788791378.746930:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788791378.747208:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788791378.748839:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788791378.749651:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788791378.749689:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788791378.749950:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788791378.750414:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788791378.755041:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788791378.755225:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788791378.755348:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788791378.755494:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788791378.755619:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788791378.762357:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788791378.762566:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788791378.762695:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788791378.762860:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788791378.762994:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788791378.763258:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788791378.763415:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788791378.763572:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788791378.763734:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788791378.763889:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788791378.764237:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788791378.764552:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788791378.764706:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788791378.764867:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788791378.765019:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788791378.765448:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788791378.765587:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788791378.767600:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788791378.767847:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788791378.768420:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788791378.768582:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788791378.768767:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788791378.768909:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788791378.769163:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788791378.769306:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788791378.769462:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788791378.769601:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788791378.769816:0:5818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1788791378.787192:0:5871:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788791378.829202:0:5818:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788791378.829239:0:5818:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadda42a27988 00100000:10000000:0.0:1788791378.829247:0:5818:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788791378.830768:0:5818:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788791378.830784:0:5818:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788791378.830804:0:5818:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788791378.830831:0:5818:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788791378.876879:0:5871:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788791378.876955:0:5871:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788791378.876959:0:5871:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788791379.619491:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791380.656208:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791381.669528:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791382.693697:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791383.718238:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791383.849809:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000333b7834 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630386304:0@lo:400: 00000100:00100000:1.0:1788791383.849887:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788791383.851089:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788791383.851095:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788791383.851098:0:8:0:(import.c:65:import_set_state_nolock()) 000000009e068783 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788791383.851107:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009e068783 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788791383.851150:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e4221ff7 x1875683630386432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788791383.851223:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4221ff7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875683630386432:0@lo:38: 00000100:00100000:2.0:1788791383.851312:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791383.851432:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630386304 00000100:00100000:1.0:1788791383.851440:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630386304 00000100:00100000:1.0:1788791383.852688:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788791383.852706:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa1f623f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:3314:x1875683630386304:12345-0@lo:400: 00000100:00100000:1.0:1788791383.852790:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa1f623f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:3314:x1875683630386304:12345-0@lo:400: Request processed in 91us (2904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791383.852797:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788791383.853095:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630386432 00000100:00100000:0.0:1788791383.853102:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630386432 00000100:00100000:0.0:1788791383.853143:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788791383.853147:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013d4bc2a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875683630386432:12345-0@lo:38: 00010000:00080000:0.0:1788791383.853171:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:0.0:1788791383.854031:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcd6380150a322a6c 00000004:00100000:0.0:1788791383.854099:0:5839:0:(mdt_handler.c:7335:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788791383.854272:0:5839:0:(import.c:65:import_set_state_nolock()) 00000000c27033e6 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788791383.854341:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013d4bc2a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875683630386432:12345-0@lo:38: Request processed in 1192us (3029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791383.854350:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788791383.854417:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000333b7834 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630386304:0@lo:400: 00010000:00080000:2.0:1788791383.855144:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e4221ff7 x1875683630386432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788791393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788791383.855161:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788791383.855169:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788791383.855174:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788791383.855176:0:3311:0:(import.c:65:import_set_state_nolock()) 000000009e068783 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788791383.855181:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4221ff7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875683630386432:0@lo:38: 00010000:00010000:1.0:1788791384.743046:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788791384.847398:0:6114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1788791384.867471:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788791384.867481:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9aba98e4f000 from 3 10000000:01000000:0.0:1788791384.867488:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788791384.867535:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 00000000a5d5a85e/0xcd6380150a322a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791384.867550:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 00000000a5d5a85e/0xcd6380150a322a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791384.867573:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 00000000a5d5a85e/0xcd6380150a322a73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791384.867597:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000087b4d622 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630386560:0@lo:101: 00000100:00100000:0.0:1788791384.867674:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791384.867724:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000006dcd7a25 going to sleep for 11 seconds 00000100:00100000:3.0:1788791384.867803:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630386560 00000100:00100000:3.0:1788791384.867810:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630386560 00000100:00100000:3.0:1788791384.868679:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788791384.868690:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002483ef89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:5834:x1875683630386560:12345-0@lo:101: 00010000:00010000:3.0:1788791384.868704:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791384.868717:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322a73 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791384.868739:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322a73 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791384.868749:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ad9f596e/0xcd6380150a322a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322a73 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791384.868758:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ad9f596e, rc 0) 00000100:00100000:3.0:1788791384.868818:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002483ef89 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5834:x1875683630386560:12345-0@lo:101: Request processed in 131us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791384.868824:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788791384.868898:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000087b4d622 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630386560:0@lo:101: 00010000:00010000:1.0:1788791384.868914:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 00000000a5d5a85e/0xcd6380150a322a73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322a7a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791384.868922:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 00000000a5d5a85e/0xcd6380150a322a73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322a7a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791384.868975:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060ebf9ce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630386688:0@lo:256: 00000100:00100000:1.0:1788791384.869011:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791384.873054:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000002ca80723 going to sleep for 11 seconds 00000100:00100000:2.0:1788791384.877025:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630386688 00000100:00100000:2.0:1788791384.877041:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630386688 00000100:00100000:2.0:1788791384.877323:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788791384.877333:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd5c7042 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5834:x1875683630386688:12345-0@lo:256: 20000000:01000000:2.0:1788791384.877370:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788791384.877386:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788791384.877389:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788791384.877532:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd5c7042 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5834:x1875683630386688:12345-0@lo:256: Request processed in 199us (8520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791384.877539:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788791384.882344:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060ebf9ce pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630386688:0@lo:256: 10000000:01000000:0.0:1788791384.882410:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788791384.882420:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: 00000000a5d5a85e/0xcd6380150a322a73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322a7a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791384.882430:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: 00000000a5d5a85e/0xcd6380150a322a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322a7a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791385.763742:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791386.792138:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791387.815700:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791388.836422:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791388.964273:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb0e6894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630386944:0@lo:400: 00000100:00100000:2.0:1788791388.964356:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791388.964426:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630386944 00000100:00100000:2.0:1788791388.964434:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630386944 00000100:00100000:2.0:1788791388.964474:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791388.964482:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f9beece pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630386944:12345-0@lo:400: 00000100:00100000:2.0:1788791388.964552:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f9beece pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630386944:12345-0@lo:400: Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791388.964560:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788791388.964599:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000bb0e6894 x1875683630386944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791388.964613:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb0e6894 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630386944:0@lo:400: 00000100:00100000:0.0:1788791388.964809:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e4221ff7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630386816:0@lo:400: 00000100:00100000:0.0:1788791388.964863:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791388.965259:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630386816 00000100:00100000:2.0:1788791388.965265:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630386816 00000100:00100000:2.0:1788791388.965382:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788791388.965390:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091449933 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:3315:x1875683630386816:12345-0@lo:400: 00000100:00100000:2.0:1788791388.965435:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091449933 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:3315:x1875683630386816:12345-0@lo:400: Request processed in 47us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791388.965442:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788791388.965460:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e4221ff7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630386816:0@lo:400: 00010000:00010000:1.0:1788791389.872543:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788791390.118285:0:6316:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8b698bb0 20000000:00000080:3.0:1788791390.118309:0:6316:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9aba87d9d800 uarg=0000000000000000 20000000:01000000:3.0:1788791390.118346:0:6316:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788791390.118359:0:6316:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788791390.118364:0:6316:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788791390.119632:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788791390.119650:0:6316:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788791390.123886:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788791390.124449:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788791390.124532:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788791390.124590:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788791390.124609:0:6316:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788791390.124626:0:6316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000dfb4736e/0xcd6380150a322a81 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791390.124645:0:6316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f9c018a3/0xcd6380150a322a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322a3b expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791390.124653:0:6316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000dfb4736e/0xcd6380150a322a81 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791390.124693:0:6316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f9c018a3/0xcd6380150a322a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322a3b expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791390.124709:0:6316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f9c018a3/0xcd6380150a322a42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322a3b expref: 11 pid: 5830 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791390.124723:0:6316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000227e22d1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1875683630387072:0@lo:104: 00000100:00100000:3.0:1788791390.124793:0:6316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791390.124955:0:6316:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f3454f7 going to sleep for 11 seconds 00000100:00100000:3.0:1788791390.126327:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630387072 00000100:00100000:3.0:1788791390.126339:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630387072 00000100:00100000:3.0:1788791390.126431:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788791390.126441:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000189b3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:6316:x1875683630387072:12345-0@lo:104: 00010000:00010000:3.0:1788791390.126472:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: 000000004c75a09b/0xcd6380150a322a3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322a42 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791390.126578:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788791390.126584:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000189b3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:6316:x1875683630387072:12345-0@lo:104: Request processed in 145us (1791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791390.126591:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788791390.126662:0:6316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000227e22d1 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1875683630387072:0@lo:104: 00010000:00010000:0.0:1788791390.126685:0:6316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000dfb4736e/0xcd6380150a322a81 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791390.126773:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791390.126779:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: 000000004c75a09b/0xcd6380150a322a3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322a42 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791390.126787:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004c75a09b already unused, calling callback (000000000e7501d4) 10000000:00010000:3.0:1788791390.126791:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: 000000004c75a09b/0xcd6380150a322a3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322a42 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791390.126798:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: 000000004c75a09b/0xcd6380150a322a3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322a42 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788791390.126805:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: 000000004c75a09b/0xcd6380150a322a3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322a42 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791390.126810:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788791390.129399:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: 000000004c75a09b/0xcd6380150a322a3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322a42 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791390.129420:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788791390.129476:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000060342c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630387200:0@lo:103: 00000100:00100000:2.0:1788791390.129572:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791390.130991:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630387200 00000100:00100000:1.0:1788791390.131004:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630387200 00010000:00010000:1.0:1788791390.131054:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f9c018a3/0xcd6380150a322a42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322a3b expref: 12 pid: 5830 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791390.131094:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788791390.131103:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb0e6894 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:3313:x1875683630387200:12345-0@lo:103: 00010000:00010000:1.0:1788791390.131116:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791390.131121:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f9c018a3/0xcd6380150a322a42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322a3b expref: 12 pid: 5830 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791390.131149:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f9c018a3/0xcd6380150a322a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322a3b expref: 12 pid: 5830 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791390.131166:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f9c018a3/0xcd6380150a322a42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322a3b expref: 12 pid: 5830 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791390.131183:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000dfb4736e/0xcd6380150a322a81 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791390.131190:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dfb4736e/0xcd6380150a322a81 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791390.131205:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dfb4736e/0xcd6380150a322a81 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791390.131211:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000dfb4736e/0xcd6380150a322a81 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791390.131217:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000dfb4736e/0xcd6380150a322a81 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791390.131223:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000dfb4736e/0xcd6380150a322a81 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791390.131238:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dfb4736e already unused, calling callback (00000000f9a42674) 00010000:00010000:1.0:1788791390.131242:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000dfb4736e/0xcd6380150a322a81 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791390.131248:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000dfb4736e/0xcd6380150a322a81 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791390.131265:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000dfb4736e/0xcd6380150a322a81 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791390.131276:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788791390.131443:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: 000000004c75a09b/0xcd6380150a322a3b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322a42 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791390.131452:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: 000000004c75a09b/0xcd6380150a322a3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322a42 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791390.131476:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791390.131478:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791390.131480:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791390.131556:0:6316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000dfb4736e/0xcd6380150a322a81 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791390.131565:0:6316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000dfb4736e/0xcd6380150a322a81 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791390.131571:0:6316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000dfb4736e/0xcd6380150a322a81 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791390.134363:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb0e6894 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:3313:x1875683630387200:12345-0@lo:103: Request processed in 3251us (4781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791390.134380:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788791390.134563:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000060342c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630387200:0@lo:103: 00010000:00010000:1.0:1788791390.884443:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788791391.655917:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788791391.655926:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9aba98e4f000 from 1 10000000:01000000:1.0:1788791391.655932:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788791391.655980:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: 0000000080642f81/0xcd6380150a322a88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791391.655993:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: 0000000080642f81/0xcd6380150a322a88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791391.656004:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: 0000000080642f81/0xcd6380150a322a88 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791391.656028:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000068e4fb2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630387328:0@lo:101: 00000100:00100000:1.0:1788791391.656113:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791391.656248:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ecb61948 going to sleep for 11 seconds 00000100:00100000:3.0:1788791391.656326:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630387328 00000100:00100000:3.0:1788791391.656335:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630387328 00000100:00100000:3.0:1788791391.656389:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788791391.656398:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017ef1e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:5834:x1875683630387328:12345-0@lo:101: 00010000:00010000:3.0:1788791391.656411:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791391.656423:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006d757210/0xcd6380150a322a8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322a88 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791391.656445:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d757210/0xcd6380150a322a8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322a88 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791391.656454:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006d757210/0xcd6380150a322a8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322a88 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791391.656463:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006d757210, rc 0) 00000100:00100000:3.0:1788791391.656528:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017ef1e7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5834:x1875683630387328:12345-0@lo:101: Request processed in 131us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791391.656535:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788791391.656665:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000068e4fb2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630387328:0@lo:101: 00010000:00010000:1.0:1788791391.656680:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: 0000000080642f81/0xcd6380150a322a88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322a8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791391.656688:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: 0000000080642f81/0xcd6380150a322a88 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322a8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791391.656740:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000068e4fb2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630387456:0@lo:501: 00000100:00100000:1.0:1788791391.656765:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791391.656788:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ecb61948 going to sleep for 11 seconds 00000100:00100000:3.0:1788791391.656829:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630387456 00000100:00100000:3.0:1788791391.656834:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630387456 00000100:00100000:3.0:1788791391.656863:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788791391.656869:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dbf0fcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5834:x1875683630387456:12345-0@lo:501: 00000100:00100000:3.0:1788791391.657156:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dbf0fcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5834:x1875683630387456:12345-0@lo:501: Request processed in 286us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791391.657163:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788791391.657194:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000068e4fb2b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630387456:0@lo:501: 00000100:00100000:3.0:1788791391.657221:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000060342c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630387584:0@lo:503: 00000100:00100000:3.0:1788791391.657258:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791391.657272:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fe9d2d06 going to sleep for 11 seconds 00000100:00100000:3.0:1788791391.657283:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630387584 00000100:00100000:3.0:1788791391.657287:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630387584 00000100:00100000:3.0:1788791391.657303:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788791391.657309:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c49b832c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5834:x1875683630387584:12345-0@lo:503: 00000100:00100000:3.0:1788791391.657434:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c49b832c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5834:x1875683630387584:12345-0@lo:503: Request processed in 125us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791391.657441:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788791391.657476:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000060342c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630387584:0@lo:503: 00000100:00100000:3.0:1788791391.657708:0:6374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000060342c8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:6374:1875683630387712:0@lo:502: 00000100:00100000:3.0:1788791391.657743:0:6374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791391.657762:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630387712 00000100:00100000:3.0:1788791391.657767:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630387712 00000100:00100000:3.0:1788791391.657792:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788791391.657798:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074f5d3be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6374:x1875683630387712:12345-0@lo:502: 00000100:00100000:3.0:1788791391.657914:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074f5d3be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6374:x1875683630387712:12345-0@lo:502: Request processed in 116us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791391.657921:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788791391.657947:0:6374:0:(client.c:2715:ptlrpc_set_wait()) set 0000000014dbdefe going to sleep for 11 seconds 00000100:00100000:3.0:1788791391.657959:0:6374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000060342c8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:6374:1875683630387712:0@lo:502: 00000020:01000000:3.0:1788791391.657978:0:6374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791391.657989:0:6374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791391.657992:0:6374:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788791391.657999:0:6374:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9aba98e4f000 00000020:00000080:3.0:1788791391.658002:0:6374:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788791391.658045:0:6374:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:6374:1875683630387840:0@lo:502: 00000100:00100000:3.0:1788791391.658078:0:6374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791391.658097:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630387840 00000100:00100000:3.0:1788791391.658101:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630387840 00000100:00100000:3.0:1788791391.658117:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788791391.658123:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6374:x1875683630387840:12345-0@lo:502: 00000100:00100000:3.0:1788791391.658233:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6374:x1875683630387840:12345-0@lo:502: Request processed in 110us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791391.658240:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788791391.658265:0:6374:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba891d20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791391.658277:0:6374:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:6374:1875683630387840:0@lo:502: 00000020:01000000:3.0:1788791391.658294:0:6374:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791391.658298:0:6374:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791391.658300:0:6374:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788791391.658304:0:6374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788791391.658353:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788791391.658374:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788791391.658382:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322a88 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322a8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791391.658391:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322a88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322a8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791391.918000:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791392.936889:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791393.957405:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791394.087754:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630388096:0@lo:400: 00000100:00100000:3.0:1788791394.087821:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791394.087882:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788791394.087889:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630387968:0@lo:400: 00000100:00100000:3.0:1788791394.087918:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791394.087956:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630388096 00000100:00100000:3.0:1788791394.087963:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630388096 00000100:00100000:3.0:1788791394.088006:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788791394.088013:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630388096:12345-0@lo:400: 00000100:00100000:3.0:1788791394.088057:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630388096:12345-0@lo:400: Request processed in 44us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791394.088063:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788791394.088083:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630387968 00000100:00100000:3.0:1788791394.088086:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630387968 00000100:00100000:3.0:1788791394.088105:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788791394.088111:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:3315:x1875683630387968:12345-0@lo:400: 00000100:00100000:3.0:1788791394.088158:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:3315:x1875683630387968:12345-0@lo:400: Request processed in 47us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791394.088164:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788791394.088203:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630387968:0@lo:400: 00010000:00080000:3.0:1788791394.088227:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9aba857ba300 x1875683630388096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791394.088239:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630388096:0@lo:400: 00010000:00010000:1.0:1788791394.981452:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788791395.962375:0:6677:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788791395.962379:0:6677:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788791395.962526:0:6677:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ababbc61000 00000020:01000004:2.0:1788791395.962542:0:6677:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788791395.962554:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788791395.962569:0:6677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9ababc023370) 00000020:00000080:2.0:1788791395.962585:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788791395.993547:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788791395.993803:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00010000:00010000:1.0:1788791396.005063:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788791396.040807:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788791396.058988:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788791396.059024:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788791396.059079:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788791396.059108:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788791396.059486:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788791396.059497:0:6677:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788791396.059507:0:6677:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd6380150a322a9d 00000020:01000004:3.0:1788791396.059515:0:6677:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788791396.059536:0:6677:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788791396.059540:0:6677:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788791396.059545:0:6677:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788791396.059550:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788791396.059561:0:6677:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9aba980619b8) 00000020:00000080:3.0:1788791396.059570:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788791396.067862:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788791396.068080:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788791396.068087:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788791396.069539:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788791396.069549:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788791396.069668:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788791396.069674:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788791396.070765:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788791396.070948:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788791396.070954:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788791396.073156:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788791396.073171:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788791396.108980:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788791396.109357:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788791396.109365:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788791396.112090:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788791396.112105:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788791396.114646:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788791396.114661:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788791396.116749:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788791396.116969:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788791396.116982:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788791396.118005:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788791396.118014:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788791396.187664:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788791396.187862:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788791396.187871:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788791396.189761:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788791396.189774:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788791396.190238:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788791396.190264:0:6677:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788791396.190270:0:6677:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788791396.208903:0:6677:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788791396.208942:0:6677:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788791396.208947:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788791396.208948:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788791396.208950:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788791396.208950:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788791396.208952:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788791396.208953:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788791396.208955:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788791396.208956:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788791396.208957:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788791396.208959:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788791396.208961:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788791396.208965:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788791396.208967:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788791396.208968:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788791396.208969:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788791396.208970:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788791396.208971:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788791396.208972:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788791396.208974:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788791396.208975:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788791396.208976:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788791396.208977:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788791396.208977:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788791396.209009:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788791396.209028:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc134380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630388224:0@lo:253: 00000100:00100000:1.0:1788791396.209108:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.209381:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba85141900 going to sleep for 11 seconds 00000100:00100000:0.0:1788791396.209437:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630388224 00000100:00100000:0.0:1788791396.209446:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630388224 00000100:00100000:0.0:1788791396.209573:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788791396.209614:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6677:x1875683630388224:12345-0@lo:253: 20000000:01000000:0.0:1788791396.209648:0:5831:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788791396.209652:0:5831:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788791396.209657:0:5831:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788791396.209660:0:5831:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788791396.211007:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788791396.211354:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788791396.211368:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788791396.211418:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788791396.211427:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788791396.211456:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788791396.211503:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788791396.211853:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788791396.211873:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.129@tcp 20000000:01000000:0.0:1788791396.211875:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.129@tcp (null) (null) (null) 00000040:00080000:0.0:1788791396.211928:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788791396.211937:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788791396.211988:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788791396.211997:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.129@tcp (null) (null) 00000040:00080000:0.0:1788791396.212031:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788791396.212040:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788791396.212069:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788791396.212118:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788791396.213245:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788791396.213267:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.129@tcp 20000000:01000000:1.0:1788791396.213270:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.129@tcp (null) (null) (null) 00000040:00080000:1.0:1788791396.213306:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788791396.213313:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788791396.213343:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788791396.213351:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.129@tcp (null) (null) 00000040:00080000:1.0:1788791396.213422:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788791396.213432:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788791396.213466:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788791396.213499:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788791396.213515:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788791396.213518:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788791396.213524:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788791396.213525:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788791396.213527:0:5831:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788791396.213539:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788791396.213542:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788791396.213572:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788791396.213575:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788791396.214068:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788791396.214116:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788791396.214518:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1788791396.214781:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1788791396.214823:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1788791396.214857:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1788791396.214869:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788791396.214871:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788791396.215269:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788791396.215309:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788791396.215359:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788791396.215615:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788791396.215652:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788791396.215706:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788791396.215720:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788791396.215741:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788791396.216055:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788791396.216233:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788791396.216268:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788791396.216936:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:3.0:1788791396.216959:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788791396.216981:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9aba81524c00/0xcd6380150a322aab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.216998:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9abac2170a00/0xcd6380150a3229c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a3229bd expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.217006:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba81525600/0xcd6380150a3229e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a3229d9 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.217013:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba81524600/0xcd6380150a322a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322a49 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.217020:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9aba81524c00/0xcd6380150a322aab lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.217066:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba81524600/0xcd6380150a322a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322a49 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.217083:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9aba81524600/0xcd6380150a322a50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322a49 expref: 12 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791396.217100:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857ba300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5831:1875683630388352:0@lo:104: 00000100:00100000:3.0:1788791396.217192:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788791396.217363:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba81525600/0xcd6380150a3229e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a3229d9 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.217373:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9aba81525600/0xcd6380150a3229e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a3229d9 expref: 12 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791396.217393:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5831:1875683630388480:0@lo:104: 00000100:00100000:3.0:1788791396.217432:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788791396.217578:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9abac2170a00/0xcd6380150a3229c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a3229bd expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.217587:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9abac2170a00/0xcd6380150a3229c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a3229bd expref: 12 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791396.217596:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5831:1875683630388608:0@lo:104: 00000100:00100000:3.0:1788791396.217630:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791396.217700:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630388352 00000100:00100000:0.0:1788791396.217708:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630388352 00000100:00100000:0.0:1788791396.217746:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630388480 00000100:00100000:0.0:1788791396.217749:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630388480 00000100:00100000:0.0:1788791396.217762:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788791396.217770:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+4:5831:x1875683630388352:12345-0@lo:104: 00010000:00010000:0.0:1788791396.217782:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322a50 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.217844:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788791396.217850:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+4:5831:x1875683630388352:12345-0@lo:104: Request processed in 81us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791396.217858:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788791396.217875:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788791396.217881:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:5831:x1875683630388480:12345-0@lo:104: 00010000:00010000:0.0:1788791396.217888:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a3229d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a3229e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.217922:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788791396.217928:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:5831:x1875683630388480:12345-0@lo:104: Request processed in 47us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791396.217933:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788791396.217949:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788791396.217955:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322a50 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.217963:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abaa1b5ca00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791396.217967:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322a49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322a50 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.217976:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322a50 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791396.217984:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322a49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322a50 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791396.217991:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788791396.218027:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322a49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322a50 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.218034:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788791396.218052:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322a49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322a50 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.218059:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322a49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322a50 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.218073:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791396.218076:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a3229d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a3229e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.218082:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abaa1b5c800 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791396.218085:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a3229d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a3229e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.218092:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a3229d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a3229e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791396.218099:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a3229d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a3229e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791396.218104:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788791396.218115:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a3229d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a3229e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.218122:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788791396.218165:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a3229d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a3229e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.218182:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a3229d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a3229e0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.218193:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791396.218195:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791396.218197:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791396.218218:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630388736:0@lo:103: 00000100:00100000:0.0:1788791396.218248:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791396.218271:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788791396.218277:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630388864:0@lo:103: 00000100:00100000:0.0:1788791396.218298:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791396.218335:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630388736 00000100:00100000:0.0:1788791396.218339:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630388736 00010000:00010000:0.0:1788791396.218357:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba81524600/0xcd6380150a322a50 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322a49 expref: 13 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791396.218375:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630388864 00000100:00100000:0.0:1788791396.218378:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630388864 00010000:00010000:0.0:1788791396.218389:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba81525600/0xcd6380150a3229e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a3229d9 expref: 14 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791396.218401:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788791396.218421:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:3312:x1875683630388736:12345-0@lo:103: 00010000:00010000:0.0:1788791396.218431:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791396.218437:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba81524600/0xcd6380150a322a50 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322a49 expref: 14 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.218447:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba81524600/0xcd6380150a322a50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322a49 expref: 14 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.218466:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791396.218492:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:3312:x1875683630388736:12345-0@lo:103: Request processed in 85us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791396.218498:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788791396.218512:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788791396.218532:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:3312:x1875683630388864:12345-0@lo:103: 00010000:00010000:0.0:1788791396.218540:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791396.218544:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba81525600/0xcd6380150a3229e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a3229d9 expref: 13 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.218553:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba81525600/0xcd6380150a3229e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a3229d9 expref: 13 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.218563:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791396.218582:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:3312:x1875683630388864:12345-0@lo:103: Request processed in 52us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791396.218588:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788791396.218618:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630388864:0@lo:103: 00000100:00100000:0.0:1788791396.218627:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630388736:0@lo:103: 00010000:00010000:1.0:1788791396.218719:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791396.218798:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba99510900 going to sleep for 11 seconds 00010000:00010000:3.0:1788791396.218814:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba81524600/0xcd6380150a322a50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322a49 expref: 12 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791396.218824:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857ba300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5831:1875683630388352:0@lo:104: 00010000:00010000:3.0:1788791396.218832:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba81525600/0xcd6380150a3229e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a3229d9 expref: 11 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791396.218840:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5831:1875683630388480:0@lo:104: 00000100:00100000:0.0:1788791396.219028:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630388608 00000100:00100000:0.0:1788791396.219033:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630388608 00000100:00100000:0.0:1788791396.219053:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788791396.219059:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:5831:x1875683630388608:12345-0@lo:104: 00010000:00010000:0.0:1788791396.219069:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a3229bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a3229c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791396.219213:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b8e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5831:1875683630388608:0@lo:104: 00010000:00010000:3.0:1788791396.219231:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9aba81524c00/0xcd6380150a322aab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.219285:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788791396.219292:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:5831:x1875683630388608:12345-0@lo:104: Request processed in 232us (1661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791396.219298:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788791396.219342:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791396.219348:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a3229bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a3229c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.219360:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abaa1b5c600 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791396.219364:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a3229bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a3229c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.219371:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a3229bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a3229c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791396.219378:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a3229bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a3229c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791396.219383:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788791396.219424:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a3229bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a3229c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.219431:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791396.219454:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a3229bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a3229c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.219461:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a3229bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a3229c4 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.219475:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791396.219477:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791396.219479:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791396.219523:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630388992:0@lo:103: 00000100:00100000:3.0:1788791396.219553:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.219629:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630388992 00000100:00100000:1.0:1788791396.219634:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630388992 00010000:00010000:1.0:1788791396.219650:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9abac2170a00/0xcd6380150a3229c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a3229bd expref: 11 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791396.219667:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788791396.219680:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:3314:x1875683630388992:12345-0@lo:103: 00010000:00010000:1.0:1788791396.219689:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791396.219694:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9abac2170a00/0xcd6380150a3229c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a3229bd expref: 11 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.219704:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9abac2170a00/0xcd6380150a3229c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a3229bd expref: 11 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.219715:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abac2170a00/0xcd6380150a3229c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a3229bd expref: 11 pid: 5830 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.219728:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9aba81524c00/0xcd6380150a322aab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.219735:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba81524c00/0xcd6380150a322aab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.219748:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9aba81524c00/0xcd6380150a322aab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.219754:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9aba81524c00/0xcd6380150a322aab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.219761:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9aba81524c00/0xcd6380150a322aab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.219767:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9aba81524c00/0xcd6380150a322aab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.219773:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81524c00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791396.219777:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9aba81524c00/0xcd6380150a322aab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.219790:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9aba81524c00/0xcd6380150a322aab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.219811:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9aba81524c00/0xcd6380150a322aab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.219820:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791396.219850:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+10:3314:x1875683630388992:12345-0@lo:103: Request processed in 171us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791396.219857:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788791396.219919:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630388992:0@lo:103: 00010000:00010000:3.0:1788791396.219947:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9aba81524c00/0xcd6380150a322aab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.219954:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9aba81524c00/0xcd6380150a322aab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.219960:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba81524c00/0xcd6380150a322aab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788791396.219971:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788791396.264069:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+9:6677:x1875683630388224:12345-0@lo:253: Request processed in 54459us (54951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791396.264082:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788791396.264355:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc134380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630388224:0@lo:253: 10000000:01000000:1.0:1788791396.264371:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788791396.264374:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788791396.264375:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788791396.264377:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788791396.264378:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788791396.264379:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788791396.264380:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788791396.264381:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788791396.264383:0:6677:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788791396.264384:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788791396.264385:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788791396.264416:0:6677:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ababbc61000 from lustre-OST0000 10000000:01000000:1.0:1788791396.264439:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788791396.264442:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788791396.264447:0:6677:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9aba88c60000 local copy 10000000:01000000:1.0:1788791396.264451:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788791396.264485:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322ab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.264496:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322ab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.264518:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322ab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791396.264536:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc134380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630389120:0@lo:101: 00000100:00100000:1.0:1788791396.264574:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.264634:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791396.264826:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630389120 00000100:00100000:0.0:1788791396.264833:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630389120 00000100:00100000:0.0:1788791396.264880:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788791396.264889:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+9:6677:x1875683630389120:12345-0@lo:101: 00010000:00010000:0.0:1788791396.264902:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791396.264919:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994ff400/0xcd6380150a322ab9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322ab2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.264943:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ff400/0xcd6380150a322ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322ab2 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.264954:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994ff400/0xcd6380150a322ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322ab2 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.264963:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff400, rc 0) 00000100:00100000:0.0:1788791396.265005:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+10:6677:x1875683630389120:12345-0@lo:101: Request processed in 117us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791396.265011:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788791396.265170:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc134380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630389120:0@lo:101: 00010000:00010000:1.0:1788791396.265184:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322ab2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcd6380150a322ab9 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.265193:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322ab2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd6380150a322ab9 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791396.265321:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc134380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630389248:0@lo:501: 00000100:00100000:1.0:1788791396.265347:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.265375:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791396.265529:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630389248 00000100:00100000:0.0:1788791396.265534:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630389248 00000100:00100000:0.0:1788791396.265579:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788791396.265586:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+10:6677:x1875683630389248:12345-0@lo:501: 00000100:00100000:0.0:1788791396.265933:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+10:6677:x1875683630389248:12345-0@lo:501: Request processed in 346us (583us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788791396.265941:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788791396.266022:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc134380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630389248:0@lo:501: 10000000:01000000:1.0:1788791396.266039:0:6677:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788791396.266065:0:6677:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788791396.266071:0:6677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322ab2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd6380150a322ab9 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.266079:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322ab2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd6380150a322ab9 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.266087:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd6380150a322ab9 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.266251:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788791396.266274:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ababbc61000 10000000:01000000:1.0:1788791396.266279:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788791396.266283:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9aba88c60000 10000000:01000000:1.0:1788791396.266285:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788791396.266288:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9aba88c60000 from 1 10000000:01000000:1.0:1788791396.266291:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788791396.266312:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d400/0xcd6380150a322ac0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.266320:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d400/0xcd6380150a322ac0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.266328:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d400/0xcd6380150a322ac0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791396.266340:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc134380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630389376:0@lo:101: 00000100:00100000:1.0:1788791396.266368:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.266398:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a3180 going to sleep for 11 seconds 00000100:00100000:3.0:1788791396.267690:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630389376 00000100:00100000:3.0:1788791396.267701:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630389376 00000100:00100000:3.0:1788791396.267766:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788791396.267775:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+10:6677:x1875683630389376:12345-0@lo:101: 00010000:00010000:3.0:1788791396.267787:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791396.267801:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba81524c00/0xcd6380150a322ac7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322ac0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.267821:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba81524c00/0xcd6380150a322ac7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322ac0 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.267831:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba81524c00/0xcd6380150a322ac7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322ac0 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.267838:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba81524c00, rc 0) 00000100:00100000:3.0:1788791396.267897:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:6677:x1875683630389376:12345-0@lo:101: Request processed in 124us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791396.267903:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788791396.268055:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc134380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630389376:0@lo:101: 00010000:00010000:1.0:1788791396.268071:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d400/0xcd6380150a322ac0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ac7 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.268080:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d400/0xcd6380150a322ac0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322ac7 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791396.268108:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788791396.268151:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d400/0xcd6380150a322ac0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ac7 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.268172:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d400/0xcd6380150a322ac0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ac7 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791396.268180:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788791396.268184:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788791396.268189:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788791396.268191:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788791396.268213:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c200/0xcd6380150a322ace lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.268221:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c200/0xcd6380150a322ace lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.268228:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c200/0xcd6380150a322ace lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791396.268244:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc134380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630389504:0@lo:101: 00000100:00100000:1.0:1788791396.268275:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.268301:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a3180 going to sleep for 11 seconds 00000100:00100000:0.0:1788791396.268509:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630389504 00000100:00100000:0.0:1788791396.268514:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630389504 00000100:00100000:0.0:1788791396.268551:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788791396.268559:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:6677:x1875683630389504:12345-0@lo:101: 00010000:00010000:0.0:1788791396.268567:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791396.268576:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ad5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322ace expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.268590:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322ace expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.268598:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322ace expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.268605:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff800, rc 0) 00000100:00100000:0.0:1788791396.268645:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6677:x1875683630389504:12345-0@lo:101: Request processed in 87us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791396.268650:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788791396.268831:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc134380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630389504:0@lo:101: 00010000:00010000:1.0:1788791396.268843:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c200/0xcd6380150a322ace lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ad5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.268851:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c200/0xcd6380150a322ace lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322ad5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791396.268943:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc134380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630389632:0@lo:501: 00000100:00100000:1.0:1788791396.268977:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.268998:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a3180 going to sleep for 11 seconds 00000100:00100000:0.0:1788791396.269054:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630389632 00000100:00100000:0.0:1788791396.269059:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630389632 00000100:00100000:0.0:1788791396.269090:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788791396.269097:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6677:x1875683630389632:12345-0@lo:501: 00000100:00100000:0.0:1788791396.269455:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6677:x1875683630389632:12345-0@lo:501: Request processed in 358us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791396.269468:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788791396.269547:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc134380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630389632:0@lo:501: 00000100:00100000:1.0:1788791396.269575:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc134380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630389760:0@lo:503: 00000100:00100000:1.0:1788791396.269612:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.269646:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a3180 going to sleep for 11 seconds 00000100:00100000:3.0:1788791396.269710:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630389760 00000100:00100000:3.0:1788791396.269726:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630389760 00000100:00100000:3.0:1788791396.269764:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788791396.269771:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6677:x1875683630389760:12345-0@lo:503: 00000100:00100000:3.0:1788791396.269929:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6677:x1875683630389760:12345-0@lo:503: Request processed in 158us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791396.269935:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788791396.270205:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc134380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630389760:0@lo:503: 00000040:00080000:0.0:1788791396.270553:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788791396.270619:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630389888:0@lo:502: 00000100:00100000:0.0:1788791396.270661:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791396.270698:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8665a3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788791396.270848:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791396.270856:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd6380150a322ab9 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.270865:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abaa1b5c600 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791396.270870:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd6380150a322ab9 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.270879:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcd6380150a322ab9 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791396.270887:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcd6380150a322ab9 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791396.270893:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788791396.270916:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322ab2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd6380150a322ab9 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.270922:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791396.270945:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322ab2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd6380150a322ab9 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.270965:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322ab2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd6380150a322ab9 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.270977:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791396.270979:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791396.270981:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791396.270990:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791396.271000:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630390016:0@lo:103: 00000100:00100000:2.0:1788791396.271029:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791396.271056:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630390016 00000100:00100000:2.0:1788791396.271061:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630390016 00000100:00100000:2.0:1788791396.271097:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791396.271217:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:3314:x1875683630390016:12345-0@lo:103: 00010000:00010000:2.0:1788791396.271232:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791396.271246:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994ff400/0xcd6380150a322ab9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a322ab2 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.271257:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791396.271290:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:3314:x1875683630390016:12345-0@lo:103: Request processed in 186us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791396.271297:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791396.271337:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc145180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630390016:0@lo:103: 00000100:00100000:3.0:1788791396.271417:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630389888 00000100:00100000:3.0:1788791396.271421:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630389888 00000100:00100000:3.0:1788791396.271451:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788791396.271457:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:6677:x1875683630389888:12345-0@lo:502: 00000100:00100000:3.0:1788791396.271646:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:6677:x1875683630389888:12345-0@lo:502: Request processed in 188us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791396.271653:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788791396.277010:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630389888:0@lo:502: 00000040:00080000:1.0:1788791396.277497:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788791396.277587:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788791396.277623:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788791396.277668:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788791396.277703:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788791396.277879:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788791396.277923:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630390144:0@lo:502: 00000100:00100000:1.0:1788791396.277997:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.278117:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791396.287299:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630390144 00000100:00100000:2.0:1788791396.287317:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630390144 00000100:00100000:2.0:1788791396.287384:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788791396.287394:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:6677:x1875683630390144:12345-0@lo:502: 00000100:00100000:2.0:1788791396.287733:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:6677:x1875683630390144:12345-0@lo:502: Request processed in 340us (9735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791396.287743:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788791396.287996:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630390144:0@lo:502: 00000040:00080000:1.0:1788791396.288193:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788791396.288209:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1788791396.291530:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788791396.291542:0:6696:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1788791396.291549:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791396.291551:0:6696:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788791396.291556:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788791396.291573:0:6696:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ababc1499b8) 00000020:00000080:0.0:1788791396.291596:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788791396.291601:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788791396.291687:0:6696:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ababbc61000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788791396.291695:0:6696:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788791396.291701:0:6696:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd6380150a322ae3 00010000:00010000:1.0:1788791396.300735:0:6696:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1788791396.301079:0:6696:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788791396.303780:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788791396.304060:0:6696:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788791396.314250:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788791396.315176:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788791396.319532:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788791396.319545:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788791396.319552:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791396.319554:0:6696:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788791396.319558:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788791396.319562:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791396.319563:0:6696:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788791396.319566:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788791396.319568:0:6696:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788791396.319624:0:6696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788791396.319628:0:6696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791396.319629:0:6696:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788791396.319632:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788791396.319895:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788791396.319920:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788791396.319943:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c200/0xcd6380150a322ace lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ad5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.319954:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c200/0xcd6380150a322ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ad5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791396.319963:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ababbc61000 from 1 10000000:01000000:3.0:1788791396.319966:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788791396.320002:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba81525600/0xcd6380150a322aea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.320011:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba81525600/0xcd6380150a322aea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.320022:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba81525600/0xcd6380150a322aea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791396.320051:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630390272:0@lo:101: 00000100:00100000:3.0:1788791396.320157:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791396.320202:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ab9811f1240 going to sleep for 11 seconds 00000100:00100000:2.0:1788791396.320389:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630390272 00000100:00100000:2.0:1788791396.320396:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630390272 00000100:00100000:2.0:1788791396.320453:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788791396.320463:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:6677:x1875683630390272:12345-0@lo:101: 00010000:00010000:2.0:1788791396.320476:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791396.320489:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abac2170400/0xcd6380150a322af1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322aea expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.320513:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abac2170400/0xcd6380150a322af1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322aea expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.320535:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abac2170400/0xcd6380150a322af1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322aea expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.320544:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abac2170400, rc 0) 00000100:00100000:2.0:1788791396.320606:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6677:x1875683630390272:12345-0@lo:101: Request processed in 145us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791396.320614:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788791396.320692:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630390272:0@lo:101: 00010000:00010000:0.0:1788791396.320707:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba81525600/0xcd6380150a322aea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322af1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.320730:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba81525600/0xcd6380150a322aea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322af1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791396.320825:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630390400:0@lo:501: 00000100:00100000:0.0:1788791396.320853:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791396.320884:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8665a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791396.320988:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630390400 00000100:00100000:2.0:1788791396.320993:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630390400 00000100:00100000:2.0:1788791396.321022:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788791396.321029:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6677:x1875683630390400:12345-0@lo:501: 00000100:00100000:2.0:1788791396.321278:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6677:x1875683630390400:12345-0@lo:501: Request processed in 249us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791396.321285:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788791396.321483:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630390400:0@lo:501: 00000100:00100000:0.0:1788791396.321513:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630390528:0@lo:503: 00000100:00100000:0.0:1788791396.321553:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791396.321575:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8665a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791396.321590:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630390528 00000100:00100000:0.0:1788791396.321594:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630390528 00000100:00100000:0.0:1788791396.321613:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788791396.321619:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6677:x1875683630390528:12345-0@lo:503: 00000100:00100000:0.0:1788791396.321858:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6677:x1875683630390528:12345-0@lo:503: Request processed in 237us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791396.321865:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788791396.321903:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630390528:0@lo:503: 00000040:00080000:0.0:1788791396.322178:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788791396.322233:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630390656:0@lo:502: 00000100:00100000:0.0:1788791396.322264:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791396.322278:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8665a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791396.322291:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630390656 00000100:00100000:0.0:1788791396.322294:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630390656 00000100:00100000:0.0:1788791396.322310:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788791396.322316:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6677:x1875683630390656:12345-0@lo:502: 00000100:00100000:0.0:1788791396.322460:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6677:x1875683630390656:12345-0@lo:502: Request processed in 144us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791396.322467:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788791396.322500:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630390656:0@lo:502: 00000040:00080000:0.0:1788791396.322724:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788791396.322783:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788791396.322804:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630390784:0@lo:502: 00000100:00100000:0.0:1788791396.322837:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791396.322853:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8665a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791396.322866:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630390784 00000100:00100000:0.0:1788791396.322870:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630390784 00000100:00100000:0.0:1788791396.322889:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788791396.322894:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6677:x1875683630390784:12345-0@lo:502: 00000100:00100000:0.0:1788791396.323001:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6677:x1875683630390784:12345-0@lo:502: Request processed in 105us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791396.323010:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788791396.323057:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630390784:0@lo:502: 00000040:00080000:0.0:1788791396.323151:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788791396.323161:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788791396.324873:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788791396.324885:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791396.324887:0:6699:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788791396.324894:0:6699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ababbc61000 00000020:00000080:2.0:1788791396.324897:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788791396.324918:0:6699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788791396.324922:0:6699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791396.324924:0:6699:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788791396.324927:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788791396.329553:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788791396.329608:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788791396.329625:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba81525600/0xcd6380150a322aea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322af1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.329638:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba81525600/0xcd6380150a322aea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322af1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791396.329691:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788791396.329695:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ababbc61000 10000000:01000000:0.0:1788791396.329698:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ababbc61000 10000000:01000000:0.0:1788791396.329702:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788791396.329710:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ababbc61000 from 1 10000000:01000000:0.0:1788791396.329712:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788791396.329763:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322af8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.329781:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322af8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.329793:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322af8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791396.329816:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630390912:0@lo:101: 00000100:00100000:0.0:1788791396.329889:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791396.329932:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8665a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788791396.329973:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630390912 00000100:00100000:0.0:1788791396.329980:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630390912 00000100:00100000:0.0:1788791396.336450:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788791396.336471:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:6677:x1875683630390912:12345-0@lo:101: 00010000:00010000:0.0:1788791396.336488:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791396.336507:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994ff000/0xcd6380150a322aff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322af8 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.336537:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ff000/0xcd6380150a322aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322af8 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.336547:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994ff000/0xcd6380150a322aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322af8 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.336557:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff000, rc 0) 00000100:00100000:0.0:1788791396.336644:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:6677:x1875683630390912:12345-0@lo:101: Request processed in 181us (6754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791396.336651:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788791396.337888:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630390912:0@lo:101: 00010000:00010000:1.0:1788791396.337914:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322af8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322aff expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.337945:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322af8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322aff expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791396.338069:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630391040:0@lo:501: 00000100:00100000:1.0:1788791396.338212:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.338258:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791396.338329:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630391040 00000100:00100000:3.0:1788791396.338337:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630391040 00000100:00100000:3.0:1788791396.338380:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788791396.338389:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:6677:x1875683630391040:12345-0@lo:501: 00000100:00100000:3.0:1788791396.338652:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:6677:x1875683630391040:12345-0@lo:501: Request processed in 262us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791396.338659:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788791396.338802:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630391040:0@lo:501: 00000100:00100000:1.0:1788791396.338831:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630391168:0@lo:503: 00000100:00100000:1.0:1788791396.338870:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.338892:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788791396.338953:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630391168 00000100:00100000:0.0:1788791396.338965:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630391168 00000100:00100000:0.0:1788791396.338985:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788791396.338991:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:6677:x1875683630391168:12345-0@lo:503: 00000100:00100000:0.0:1788791396.339884:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:6677:x1875683630391168:12345-0@lo:503: Request processed in 889us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791396.339893:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788791396.340275:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630391168:0@lo:503: 00000040:00080000:1.0:1788791396.340627:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788791396.340712:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630391296:0@lo:502: 00000100:00100000:1.0:1788791396.341960:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.342045:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788791396.352374:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630391296 00000100:00100000:0.0:1788791396.352391:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630391296 00000100:00100000:0.0:1788791396.352515:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788791396.352527:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:6677:x1875683630391296:12345-0@lo:502: 00000100:00100000:0.0:1788791396.352884:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:6677:x1875683630391296:12345-0@lo:502: Request processed in 359us (10924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791396.352891:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788791396.353173:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630391296:0@lo:502: 00000040:00080000:1.0:1788791396.353479:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788791396.353623:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788791396.353663:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788791396.353788:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788791396.353831:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788791396.353878:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788791396.353915:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788791396.353949:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788791396.353997:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788791396.354033:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788791396.354076:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788791396.354344:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788791396.354388:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788791396.354436:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788791396.354487:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788791396.354674:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788791396.354709:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788791396.354842:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788791396.354880:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788791396.354915:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788791396.354963:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788791396.354999:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788791396.355031:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788791396.355077:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788791396.355476:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788791396.355838:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788791396.356039:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788791396.356071:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1788791396.356114:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630391424:0@lo:502: 00000100:00100000:1.0:1788791396.356226:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.356274:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788791396.356280:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630391424 00000100:00100000:2.0:1788791396.356288:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630391424 00000100:00100000:2.0:1788791396.356333:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788791396.356339:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:6677:x1875683630391424:12345-0@lo:502: 00000100:00100000:2.0:1788791396.356509:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:6677:x1875683630391424:12345-0@lo:502: Request processed in 169us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791396.356526:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788791396.356996:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc137100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630391424:0@lo:502: 00000040:00080000:1.0:1788791396.357056:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788791396.357064:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788791396.358234:0:6701:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788791396.358251:0:6701:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9aba88c64d28) 00000020:00000080:1.0:1788791396.358273:0:6701:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788791396.358361:0:6701:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ababbc61000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788791396.358366:0:6701:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ababbc61000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788791396.358368:0:6701:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ababbc61000 3 00010000:00080000:1.0:1788791396.358397:0:6701:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ab9818e3800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.129@tcp at head 00010000:00010000:1.0:1788791396.360729:0:6701:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788791396.361080:0:6701:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788791396.361114:0:6701:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788791396.361166:0:6701:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcd6380150a322b0d 00000100:00080000:1.0:1788791396.361177:0:6701:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788791396.361183:0:6701:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9ab9818e3800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788791396.361229:0:6701:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ababc137100 x1875683630391552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788791396.361259:0:6701:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788791396.361299:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875683630391552:0@lo:38: 00000100:00100000:3.0:1788791396.361369:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788791396.361646:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:1.0:1788791396.362011:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630391552 00000100:00100000:1.0:1788791396.362019:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630391552 00000100:00100000:1.0:1788791396.362053:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788791396.362061:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875683630391552:12345-0@lo:38: 00010000:00080000:1.0:1788791396.362083:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:1.0:1788791396.362109:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcd6380150a322b14 00000004:00100000:1.0:1788791396.362123:0:5839:0:(mdt_handler.c:7335:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788791396.362181:0:5839:0:(import.c:65:import_set_state_nolock()) ffff9ab9818e3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788791396.362231:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875683630391552:12345-0@lo:38: Request processed in 169us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791396.362239:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788791396.362493:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788791396.362504:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630391680:0@lo:400: 00000100:00100000:0.0:1788791396.362539:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1788791396.362569:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788791396.362594:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788791396.362616:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322af8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322aff expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.362626:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322aff expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788791396.362669:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788791396.362671:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788791396.362673:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791396.362674:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791396.362676:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791396.362681:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791396.362683:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788791396.362684:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788791396.362685:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788791396.362686:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791396.362688:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788791396.362691:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788791396.362693:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788791396.362694:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788791396.362695:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791396.362696:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791396.362697:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791396.362699:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791396.362700:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788791396.362701:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788791396.362702:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788791396.362702:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791396.362703:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788791396.362717:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788791396.362726:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630391808:0@lo:253: 00000100:00100000:0.0:1788791396.362758:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791396.362780:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8665a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791396.362797:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630391808 00000100:00100000:0.0:1788791396.362800:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630391808 00000100:00100000:0.0:1788791396.362829:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788791396.362836:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:6677:x1875683630391808:12345-0@lo:253: 20000000:01000000:0.0:1788791396.363484:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788791396.363499:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788791396.363995:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630391680 00000100:00100000:3.0:1788791396.364002:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630391680 00000100:00100000:3.0:1788791396.364046:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788791396.364054:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630391680:12345-0@lo:400: 00000100:00100000:3.0:1788791396.364121:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630391680:12345-0@lo:400: Request processed in 67us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791396.364142:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788791396.364200:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ababc137100 x1875683630391552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788791406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791396.364211:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788791396.364219:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1788791396.364227:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788791396.364237:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788791396.364241:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ab9818e3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788791396.364248:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875683630391552:0@lo:38: 00010000:00080000:3.0:1788791396.364313:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9abab299c380 x1875683630391680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791396.364323:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630391680:0@lo:400: 20000000:01000000:3.0:1788791396.422974:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788791396.422996:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788791396.423863:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788791396.423870:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788791396.423894:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322b1b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.423912:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba81525000/0xcd6380150a322a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322a73 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.423939:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322b1b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.423978:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba81525000/0xcd6380150a322a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322a73 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.423991:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9aba81525000/0xcd6380150a322a7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322a73 expref: 13 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791396.424004:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc137480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875683630391936:0@lo:104: 00000100:00100000:1.0:1788791396.424076:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.424195:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba85001300 going to sleep for 11 seconds 00000100:00100000:0.0:1788791396.424449:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630391936 00000100:00100000:0.0:1788791396.424458:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630391936 00000100:00100000:0.0:1788791396.424509:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788791396.424526:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:5853:x1875683630391936:12345-0@lo:104: 00010000:00010000:0.0:1788791396.424539:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322a7a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791396.424610:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788791396.424617:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:5853:x1875683630391936:12345-0@lo:104: Request processed in 93us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791396.424623:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788791396.424706:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc137480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875683630391936:0@lo:104: 00010000:00010000:3.0:1788791396.424728:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322b1b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.424818:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791396.424824:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322a7a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.424831:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe800 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791396.424834:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322a73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322a7a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.424842:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322a7a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791396.424848:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322a7a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791396.424853:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788791396.424886:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322a73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322a7a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.424900:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788791396.424948:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788791396.425983:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322a73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322a7a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.425995:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322a73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322a7a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.426015:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791396.426017:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791396.426019:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791396.434610:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:6677:x1875683630391808:12345-0@lo:253: Request processed in 71763us (71840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791396.434626:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788791396.434842:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630392064:0@lo:103: 00000100:00100000:2.0:1788791396.434887:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791396.435016:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630392064 00000100:00100000:3.0:1788791396.435024:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630392064 00010000:00010000:3.0:1788791396.435057:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba81525000/0xcd6380150a322a7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322a73 expref: 13 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791396.435091:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788791396.435110:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba856de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:3312:x1875683630392064:12345-0@lo:103: 00010000:00010000:3.0:1788791396.435145:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791396.435152:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba81525000/0xcd6380150a322a7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322a73 expref: 13 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.435164:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba81525000/0xcd6380150a322a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322a73 expref: 13 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.435180:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba81525000/0xcd6380150a322a7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322a73 expref: 13 pid: 5832 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.435210:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322b1b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.435217:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322b1b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788791396.435230:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011361735s 00010000:00010000:3.0:1788791396.435234:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322b1b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.435240:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322b1b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.435246:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322b1b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.435252:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322b1b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.435257:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abaa1b5c600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791396.435261:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322b1b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.435268:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322b1b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.435281:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322b1b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.435291:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791396.435325:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba856de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:3312:x1875683630392064:12345-0@lo:103: Request processed in 218us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791396.435332:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788791396.435370:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322b1b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.435378:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322b1b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791396.435384:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322b1b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791396.435610:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:6677:1875683630391808:0@lo:253: 10000000:01000000:1.0:1788791396.435622:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788791396.435626:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788791396.435628:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788791396.435629:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788791396.435630:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788791396.435632:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788791396.435633:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788791396.435634:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788791396.435638:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788791396.435639:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788791396.435641:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788791396.435642:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788791396.435658:0:6677:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788791396.439015:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630392064:0@lo:103: 00080000:10000000:1.0:1788791396.446121:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788791396.446910:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788791396.447909:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788791396.449080:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788791396.455574:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788791396.457040:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788791396.458390:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788791396.640136:0:6677:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788791396.640144:0:6677:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788791396.640226:0:6677:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788791396.640292:0:6677:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788791396.640310:0:6677:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788791396.640341:0:6677:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:1.0:1788791396.876443:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788791396.876462:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9aba98e4f000 from 21 10000000:01000000:1.0:1788791396.876468:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788791396.876517:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a322b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.876529:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a322b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.876542:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a322b22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791396.876566:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc135180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630392192:0@lo:101: 00000100:00100000:1.0:1788791396.876640:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.876701:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba85001e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788791396.877578:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630392192 00000100:00100000:2.0:1788791396.877593:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630392192 00000100:00100000:2.0:1788791396.877652:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788791396.877663:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5834:x1875683630392192:12345-0@lo:101: 00010000:00010000:2.0:1788791396.877682:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791396.877697:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abac2170a00/0xcd6380150a322b29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322b22 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.877723:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abac2170a00/0xcd6380150a322b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322b22 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.877734:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abac2170a00/0xcd6380150a322b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322b22 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.877743:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abac2170a00, rc 0) 00000100:00100000:2.0:1788791396.877800:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:5834:x1875683630392192:12345-0@lo:101: Request processed in 138us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791396.877808:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788791396.877842:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc135180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630392192:0@lo:101: 00010000:00010000:1.0:1788791396.877859:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a322b22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322b29 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.877868:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a322b22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322b29 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791396.878481:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc135180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630392320:0@lo:501: 00000100:00100000:1.0:1788791396.878519:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.878560:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba85001e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788791396.878819:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630392320 00000100:00100000:3.0:1788791396.878825:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630392320 00000100:00100000:3.0:1788791396.878874:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788791396.878882:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:5834:x1875683630392320:12345-0@lo:501: 00000100:00100000:3.0:1788791396.879208:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:5834:x1875683630392320:12345-0@lo:501: Request processed in 326us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791396.879215:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788791396.879418:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc135180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630392320:0@lo:501: 00000100:00100000:2.0:1788791396.879459:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc145180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630392448:0@lo:503: 00000100:00100000:2.0:1788791396.879502:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791396.879518:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8313fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788791396.880267:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630392448 00000100:00100000:3.0:1788791396.880274:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630392448 00000100:00100000:3.0:1788791396.880320:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788791396.880329:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:5834:x1875683630392448:12345-0@lo:503: 00000100:00100000:3.0:1788791396.881363:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:5834:x1875683630392448:12345-0@lo:503: Request processed in 1032us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791396.881374:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788791396.881472:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc145180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630392448:0@lo:503: 00000100:00100000:2.0:1788791396.881859:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc145180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:6710:1875683630392576:0@lo:502: 00000100:00100000:2.0:1788791396.881906:0:6710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791396.881942:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8313ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791396.883780:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630392576 00000100:00100000:3.0:1788791396.883797:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630392576 00000100:00100000:3.0:1788791396.883864:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788791396.883890:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:6710:x1875683630392576:12345-0@lo:502: 00000100:00100000:3.0:1788791396.884211:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:6710:x1875683630392576:12345-0@lo:502: Request processed in 323us (2304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791396.884219:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788791396.884477:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc145180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:6710:1875683630392576:0@lo:502: 00000100:00100000:2.0:1788791396.884539:0:6710:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc145180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:6710:1875683630392704:0@lo:502: 00000100:00100000:2.0:1788791396.884581:0:6710:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791396.884615:0:6710:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8313ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791396.884809:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630392704 00000100:00100000:3.0:1788791396.884815:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630392704 00000100:00100000:3.0:1788791396.884858:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788791396.884866:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:6710:x1875683630392704:12345-0@lo:502: 00000100:00100000:3.0:1788791396.885237:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:6710:x1875683630392704:12345-0@lo:502: Request processed in 371us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791396.885244:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788791396.885313:0:6710:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc145180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:6710:1875683630392704:0@lo:502: 00000040:00080000:2.0:1788791396.885333:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788791396.885476:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788791396.885493:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788791396.885502:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a322b22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322b29 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.885519:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a322b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322b29 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791396.885529:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788791396.885532:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9aba98e4f000 from 4 10000000:01000000:1.0:1788791396.885534:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788791396.885560:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.885568:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.885579:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322b30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791396.885592:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630392832:0@lo:101: 00000100:00100000:1.0:1788791396.885623:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.885651:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba85001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788791396.885687:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630392832 00000100:00100000:2.0:1788791396.885691:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630392832 00000100:00100000:2.0:1788791396.885720:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788791396.885727:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:5834:x1875683630392832:12345-0@lo:101: 00010000:00010000:2.0:1788791396.885735:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791396.885747:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abac2171200/0xcd6380150a322b37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322b30 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.885765:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abac2171200/0xcd6380150a322b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322b30 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.885775:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abac2171200/0xcd6380150a322b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322b30 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.885784:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abac2171200, rc 0) 00000100:00100000:2.0:1788791396.885815:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:5834:x1875683630392832:12345-0@lo:101: Request processed in 89us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791396.885821:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788791396.885929:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630392832:0@lo:101: 00010000:00010000:1.0:1788791396.885940:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322b30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322b37 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791396.885950:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322b30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322b37 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791396.886004:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630392960:0@lo:256: 00000100:00100000:1.0:1788791396.886030:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791396.886055:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba85001d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788791396.886242:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630392960 00000100:00100000:2.0:1788791396.886247:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630392960 00000100:00100000:2.0:1788791396.886274:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788791396.886280:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:5834:x1875683630392960:12345-0@lo:256: 20000000:01000000:2.0:1788791396.886297:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788791396.886313:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788791396.886316:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788791396.886381:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:5834:x1875683630392960:12345-0@lo:256: Request processed in 101us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791396.886388:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788791396.886426:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630392960:0@lo:256: 10000000:01000000:2.0:1788791396.886459:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788791396.886464:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322b30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322b37 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.886471:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322b37 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791396.886478:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788791396.886479:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788791396.886481:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788791396.886495:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.886502:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.886509:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791396.886520:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc145180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630393088:0@lo:101: 00000100:00100000:2.0:1788791396.886544:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791396.886563:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8313f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791396.886577:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630393088 00000100:00100000:2.0:1788791396.886580:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630393088 00000100:00100000:2.0:1788791396.886594:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788791396.886599:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:5834:x1875683630393088:12345-0@lo:101: 00010000:00010000:2.0:1788791396.886605:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791396.886612:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abac2171000/0xcd6380150a322b45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322b3e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.886625:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abac2171000/0xcd6380150a322b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322b3e expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.886633:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abac2171000/0xcd6380150a322b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322b3e expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.886640:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abac2171000, rc 0) 00000100:00100000:2.0:1788791396.886662:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630393088:12345-0@lo:101: Request processed in 63us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791396.886667:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788791396.886688:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc145180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630393088:0@lo:101: 00010000:00010000:2.0:1788791396.886697:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322b3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322b45 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791396.887228:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322b3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322b45 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791396.887274:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc145180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630393216:0@lo:501: 00000100:00100000:2.0:1788791396.887298:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791396.887315:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8313f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791396.887326:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630393216 00000100:00100000:2.0:1788791396.887334:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630393216 00000100:00100000:2.0:1788791396.887355:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788791396.887361:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630393216:12345-0@lo:501: 00000100:00100000:2.0:1788791396.887588:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630393216:12345-0@lo:501: Request processed in 227us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791396.887595:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788791396.887625:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc145180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630393216:0@lo:501: 00000100:00100000:2.0:1788791396.887647:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc145180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630393344:0@lo:503: 00000100:00100000:2.0:1788791396.887677:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791396.887687:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8313f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791396.887696:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630393344 00000100:00100000:2.0:1788791396.887699:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630393344 00000100:00100000:2.0:1788791396.887715:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788791396.887720:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630393344:12345-0@lo:503: 00000100:00100000:2.0:1788791396.888724:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630393344:12345-0@lo:503: Request processed in 999us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791396.888733:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788791396.888818:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc145180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630393344:0@lo:503: 00000100:00100000:2.0:1788791396.908212:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc147b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:6711:1875683630393472:0@lo:502: 00000100:00100000:2.0:1788791396.908303:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791396.908346:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630393472 00000100:00100000:2.0:1788791396.908353:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630393472 00000100:00100000:2.0:1788791396.908411:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788791396.908421:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:6711:x1875683630393472:12345-0@lo:502: 00000100:00100000:2.0:1788791396.908751:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:6711:x1875683630393472:12345-0@lo:502: Request processed in 331us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791396.908759:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788791396.908833:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba85762240 going to sleep for 11 seconds 00000100:00100000:2.0:1788791396.908855:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc147b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:6711:1875683630393472:0@lo:502: 00000020:01000000:2.0:1788791396.908886:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788791396.908894:0:6711:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788791396.908901:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791396.908904:0:6711:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788791396.908908:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788791396.908912:0:6711:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:2.0:1788791396.908935:0:6711:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788791396.908937:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788791396.908952:0:6711:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ababc0219b8) 00000020:00000080:2.0:1788791396.908972:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788791396.908977:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788791396.909057:0:6711:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788791396.909063:0:6711:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788791396.909070:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a322b53 00010000:00080000:2.0:1788791396.909118:0:6711:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ababefd3000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1788791396.909379:0:6711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788791396.989281:0:6711:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788791396.989308:0:6711:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788791396.990183:0:6711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788791396.990373:0:6711:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788791396.990433:0:6711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788791396.990485:0:6711:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788791396.992171:0:6721:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788791396.992177:0:6721:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788791396.999029:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788791396.999045:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788791396.999084:0:6711:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788791396.999106:0:6711:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd6380150a322b5a 00000100:00080000:2.0:1788791396.999117:0:6711:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788791396.999149:0:6711:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9ababefd3000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788791396.999189:0:6711:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ababc147b80 x1875683630393600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788791396.999211:0:6711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788791396.999262:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788791396.999267:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791396.999269:0:6711:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788791396.999272:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788791396.999276:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791396.999277:0:6711:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788791396.999279:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788791396.999281:0:6711:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788791396.999302:0:6711:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc144000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:6711:1875683630393728:0@lo:502: 00000100:00100000:2.0:1788791396.999366:0:6711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791396.999414:0:6711:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba857623c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791396.999457:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630393600:0@lo:8: 00000100:00100000:2.0:1788791396.999486:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791396.999566:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630393728 00000100:00100000:2.0:1788791396.999572:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630393728 00000100:00100000:1.0:1788791396.999769:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630393600 00000100:00100000:1.0:1788791396.999773:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630393600 00000100:00100000:1.0:1788791396.999797:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788791396.999805:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875683630393600:12345-0@lo:8: 00010000:00080000:1.0:1788791396.999829:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:1.0:1788791396.999853:0:6681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd6380150a322b61 00002000:00100000:1.0:1788791396.999882:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9ab9818e5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788791396.999886:0:6681:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788791396.999889:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788791396.999999:0:6681:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788791397.000177:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788791397.000198:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9ab9818e6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788791397.000247:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc146300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875683630393600:12345-0@lo:8: Request processed in 443us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791397.000254:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788791397.000279:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630393984:0@lo:400: 00000100:00100000:1.0:1788791397.000307:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791397.000326:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788791397.000331:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630393856:0@lo:400: 00000100:00100000:1.0:1788791397.000350:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791397.000430:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788791397.000440:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:6711:x1875683630393728:12345-0@lo:502: 00010000:00080000:1.0:1788791397.000956:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff9ababc147b80 x1875683630393600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788791406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791397.000965:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788791397.000971:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788791397.000978:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788791397.000981:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788791397.000989:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ababefd3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788791397.001007:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788791397.001013:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630393600:0@lo:8: 00000100:00100000:1.0:1788791397.001042:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630393984 00000100:00100000:1.0:1788791397.001048:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630393984 00000004:00080000:0.0:1788791397.001070:0:6721:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788791397.001092:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630393856 00000100:00100000:1.0:1788791397.001095:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630393856 00000100:00100000:1.0:1788791397.001108:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788791397.001114:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630393984:12345-0@lo:400: 00000100:00100000:1.0:1788791397.001180:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc137b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630393984:12345-0@lo:400: Request processed in 65us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791397.001186:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00080000:0.0:1788791397.001193:0:6721:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 173381065697ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788791397.001199:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788791397.001205:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630393856:12345-0@lo:400: 00000100:00100000:1.0:1788791397.001231:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630393856:12345-0@lo:400: Request processed in 27us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791397.001238:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788791397.001268:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ababc146a00 x1875683630393856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791397.001278:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630393856:0@lo:400: 00000100:00080000:3.0:1788791397.001283:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788791397.001287:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ababc145880 x1875683630393984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791397.001295:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630393984:0@lo:400: 00000100:00100000:2.0:1788791397.006571:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:6711:x1875683630393728:12345-0@lo:502: Request processed in 6123us (7194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791397.006586:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788791397.008180:0:6711:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc144000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:6711:1875683630393728:0@lo:502: 00000020:01000000:0.0:1788791397.008227:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791397.008234:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791397.008236:0:6711:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788791397.008241:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788791397.008359:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788791397.008375:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788791397.008386:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322b3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322b45 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791397.008420:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322b45 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791397.008430:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788791397.008433:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9aba88c60000 from 1 10000000:01000000:2.0:1788791397.008436:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788791397.008468:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2171600/0xcd6380150a322b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791397.008476:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abac2171600/0xcd6380150a322b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791397.008485:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abac2171600/0xcd6380150a322b68 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791397.008504:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc145500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630394112:0@lo:101: 00000100:00100000:2.0:1788791397.008566:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791397.008613:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba857623c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791397.008638:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630394112 00000100:00100000:2.0:1788791397.008643:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630394112 00000100:00100000:2.0:1788791397.008677:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788791397.008685:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630394112:12345-0@lo:101: 00010000:00010000:2.0:1788791397.008708:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791397.008720:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abac2171e00/0xcd6380150a322b6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322b68 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791397.008740:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abac2171e00/0xcd6380150a322b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322b68 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791397.008762:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abac2171e00/0xcd6380150a322b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322b68 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791397.008770:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abac2171e00, rc 0) 00000100:00100000:2.0:1788791397.008805:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630394112:12345-0@lo:101: Request processed in 119us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791397.008811:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788791397.008842:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc145500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630394112:0@lo:101: 00010000:00010000:2.0:1788791397.008854:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abac2171600/0xcd6380150a322b68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322b6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791397.008862:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abac2171600/0xcd6380150a322b68 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322b6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791397.008903:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc145500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630394240:0@lo:501: 00000100:00100000:2.0:1788791397.008928:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791397.008941:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba857623c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791397.008954:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630394240 00000100:00100000:2.0:1788791397.008958:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630394240 00000100:00100000:2.0:1788791397.008979:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788791397.008985:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630394240:12345-0@lo:501: 00000100:00100000:2.0:1788791397.009187:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630394240:12345-0@lo:501: Request processed in 201us (256us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788791397.009193:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788791397.009220:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc145500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630394240:0@lo:501: 10000000:01000000:2.0:1788791397.009238:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788791397.009249:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2171600/0xcd6380150a322b68 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322b6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791397.009257:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abac2171600/0xcd6380150a322b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322b6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791397.034581:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788791397.059813:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788791397.084670:0:6722:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788791397.084710:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630394368:0@lo:13: 00000100:00100000:0.0:1788791397.084712:0:6722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6722:1875683630394496:0@lo:7: 00000100:00100000:2.0:1788791397.084775:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791397.084912:0:6722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791397.084914:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630394368 00000100:00100000:3.0:1788791397.084922:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630394368 00000100:00100000:0.0:1788791397.084929:0:6722:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abaa0479300 going to sleep for 11 seconds 00000100:00100000:3.0:1788791397.084980:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788791397.084999:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875683630394368:12345-0@lo:13: 00002000:00000024:3.0:1788791397.085019:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:3.0:1788791397.085063:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875683630394368:12345-0@lo:13: Request processed in 75us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791397.085070:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788791397.085091:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788791397.085321:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9abab299f480 x1875683630394368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791397.085340:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630394368:0@lo:13: 00000100:00100000:0.0:1788791397.085433:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630394496 00000100:00100000:0.0:1788791397.085438:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630394496 00000100:00100000:0.0:1788791397.085464:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788791397.085471:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6722:x1875683630394496:12345-0@lo:7: 00002000:00080000:0.0:1788791397.091478:0:6683:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788791397.091491:0:6683:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788791397.091595:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6722:x1875683630394496:12345-0@lo:7: Request processed in 6120us (6679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791397.091606:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788791397.091872:0:6722:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9abab299dc00 x1875683630394496/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788791413 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791397.091888:0:6722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299dc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6722:1875683630394496:0@lo:7: 00000004:00080000:2.0:1788791397.091901:0:6722:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788791397.091936:0:6722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc144e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6722:1875683630394624:0@lo:5: 00000100:00100000:2.0:1788791397.092039:0:6722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791397.092084:0:6722:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abac05676c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791397.092878:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630394624 00000100:00100000:1.0:1788791397.092887:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630394624 00000100:00100000:1.0:1788791397.092941:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788791397.092950:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6722:x1875683630394624:12345-0@lo:5: 00002000:00080000:1.0:1788791397.092977:0:6682:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788791397.092981:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788791397.093294:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6722:x1875683630394624:12345-0@lo:5: Request processed in 344us (1253us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788791397.093301:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788791397.093859:0:6722:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababc144e00 x1875683630394624/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788791413 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791397.093872:0:6722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc144e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6722:1875683630394624:0@lo:5: 00000004:00080000:2.0:1788791397.093892:0:6722:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788791397.093919:0:6722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc144700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6722:1875683630394752:0@lo:700: 00000100:00100000:2.0:1788791397.093943:0:6722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791397.093981:0:6722:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abac05676c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791397.094001:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630394752 00000100:00100000:1.0:1788791397.094007:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630394752 00000100:00100000:1.0:1788791397.094080:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788791397.094088:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6722:x1875683630394752:12345-0@lo:700: 00000100:00100000:1.0:1788791397.094117:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6689:1875683630394880:0@lo:700: 00000100:00100000:1.0:1788791397.094186:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791397.094213:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba85001000 going to sleep for 11 seconds 00000100:00100000:0.0:1788791397.094274:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630394880 00000100:00100000:0.0:1788791397.094278:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630394880 00000100:00100000:0.0:1788791397.094309:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788791397.094316:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6689:x1875683630394880:12345-0@lo:700: 40000000:02000000:2.0:1788791397.127484:0:5844:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788791397.135801:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6689:x1875683630394880:12345-0@lo:700: Request processed in 41479us (41608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791397.135818:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788791397.135973:0:6689:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababc136300 x1875683630394880/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788791413 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791397.135990:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6689:1875683630394880:0@lo:700: 40000000:02000000:1.0:1788791397.136003:0:6689:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1788791397.214057:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788791397.214073:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788791397.214205:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6722:x1875683630394752:12345-0@lo:700: Request processed in 120114us (120255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791397.214218:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788791397.214282:0:6722:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababc144700 x1875683630394752/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788791413 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791397.214294:0:6722:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788791397.214326:0:6722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc144700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6722:1875683630394752:0@lo:700: 00000004:02000040:1.0:1788791397.266485:0:6722:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788791397.279067:0:6722:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6722:1875683630395008:0@lo:5: 00000100:00100000:0.0:1788791397.279254:0:6722:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791397.279295:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630395008 00000100:00100000:0.0:1788791397.279303:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630395008 00000100:00100000:0.0:1788791397.279351:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788791397.279361:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6722:x1875683630395008:12345-0@lo:5: 00000100:00100000:1.0:1788791397.283160:0:6722:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abaa0479180 going to sleep for 11 seconds 00002000:00080000:1.0:1788791397.297503:0:6683:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788791397.297525:0:6683:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788791397.318548:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6722:x1875683630395008:12345-0@lo:5: Request processed in 39181us (39287us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788791397.319861:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788791397.319938:0:6722:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9abab299d180 x1875683630395008/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788791413 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791397.319957:0:6722:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6722:1875683630395008:0@lo:5: 00000004:00080000:0.0:1788791397.319973:0:6722:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788791398.068045:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791399.075558:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791400.099302:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791401.123389:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791402.148285:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791402.281894:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630395136:0@lo:13: 00000100:00100000:1.0:1788791402.281960:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791402.282036:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630395136 00000100:00100000:1.0:1788791402.282043:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630395136 00000100:00100000:1.0:1788791402.282094:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788791402.282103:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875683630395136:12345-0@lo:13: 00002000:00000024:1.0:1788791402.282161:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791402.282206:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875683630395136:12345-0@lo:13: Request processed in 103us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791402.282212:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788791402.282232:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788791402.282260:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababc136300 x1875683630395136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791402.282277:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630395136:0@lo:13: 00000100:00100000:2.0:1788791402.287697:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630395264:0@lo:400: 00000100:00100000:2.0:1788791402.287772:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791402.287815:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791402.287822:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630395392:0@lo:400: 00000100:00100000:2.0:1788791402.287848:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791402.287878:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630395520:0@lo:400: 00000100:00100000:2.0:1788791402.287904:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791402.287950:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630395264 00000100:00100000:2.0:1788791402.287958:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630395264 00000100:00100000:2.0:1788791402.287999:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788791402.288009:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:3314:x1875683630395264:12345-0@lo:400: 00000100:00100000:2.0:1788791402.288054:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:3314:x1875683630395264:12345-0@lo:400: Request processed in 46us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791402.288061:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788791402.288089:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630395392 00000100:00100000:2.0:1788791402.288093:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630395392 00000100:00100000:2.0:1788791402.288115:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630395520 00000100:00100000:2.0:1788791402.288117:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630395520 00000100:00100000:2.0:1788791402.288165:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788791402.288171:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630395392:12345-0@lo:400: 00000100:00100000:2.0:1788791402.288204:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630395392:12345-0@lo:400: Request processed in 33us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791402.288210:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788791402.288221:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788791402.288226:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630395520:12345-0@lo:400: 00000100:00100000:2.0:1788791402.288255:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630395520:12345-0@lo:400: Request processed in 29us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791402.288261:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788791402.288317:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababc146a00 x1875683630395392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791402.288331:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc146a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630395392:0@lo:400: 00000100:00100000:2.0:1788791402.288341:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc145880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630395264:0@lo:400: 00010000:00080000:2.0:1788791402.288382:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababc147b80 x1875683630395520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791402.288390:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc147b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630395520:0@lo:400: 00000100:00080000:2.0:1788791402.288402:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1788791402.367903:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788791403.175830:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791404.195279:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788791404.426930:0:7050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788791405.219614:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791406.243297:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791407.271627:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791407.395542:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630395648:0@lo:400: 00000100:00100000:2.0:1788791407.395609:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791407.395662:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630395648 00000100:00100000:2.0:1788791407.395666:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788791407.395671:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630395648 00000100:00100000:2.0:1788791407.395674:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630396032:0@lo:400: 00000100:00100000:2.0:1788791407.395701:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791407.395733:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630395904:0@lo:400: 00000100:00100000:3.0:1788791407.395738:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788791407.395751:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:3313:x1875683630395648:12345-0@lo:400: 00000100:00100000:2.0:1788791407.395763:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791407.395781:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788791407.395786:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630395776:0@lo:400: 00000100:00100000:1.0:1788791407.395892:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630396032 00000100:00100000:1.0:1788791407.395910:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630396032 00000100:00100000:1.0:1788791407.395949:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788791407.395952:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:3313:x1875683630395648:12345-0@lo:400: Request processed in 205us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791407.395956:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630396032:12345-0@lo:400: 00000100:00100000:3.0:1788791407.395960:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788791407.395988:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630396032:12345-0@lo:400: Request processed in 33us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791407.395994:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788791407.396005:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9aba857b8380 x1875683630396032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791407.396015:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788791407.396030:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630396032:0@lo:400: 00000100:00100000:3.0:1788791407.396040:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630395648:0@lo:400: 00000100:00100000:3.0:1788791407.396053:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630396160:0@lo:13: 00000100:00080000:1.0:1788791407.396062:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788791407.396075:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791407.396114:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630396160 00000100:00100000:3.0:1788791407.396117:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630396160 00000100:00100000:3.0:1788791407.396157:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788791407.396163:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630396160:12345-0@lo:13: 00002000:00000024:3.0:1788791407.396186:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791407.396240:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630396160:12345-0@lo:13: Request processed in 77us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791407.396246:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788791407.396425:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababc136300 x1875683630396160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791407.396440:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630396160:0@lo:13: 00000100:00100000:3.0:1788791407.396473:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630395904 00000100:00100000:3.0:1788791407.396477:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630395904 00000100:00100000:3.0:1788791407.396713:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788791407.396721:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630395904:12345-0@lo:400: 00000100:00100000:3.0:1788791407.396759:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630395904:12345-0@lo:400: Request processed in 39us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791407.396764:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788791407.397299:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791407.398070:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788791407.398143:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9aba857b8a80 x1875683630395904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791407.398157:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630395904:0@lo:400: 00000100:00100000:1.0:1788791407.398437:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630395776 00000100:00100000:1.0:1788791407.398446:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630395776 00000100:00100000:1.0:1788791407.398550:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788791407.398561:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630395776:12345-0@lo:400: 00000100:00100000:1.0:1788791407.398635:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630395776:12345-0@lo:400: Request processed in 76us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791407.398642:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788791407.399062:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9aba857b8700 x1875683630395776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791407.399074:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630395776:0@lo:400: 00010000:00010000:0.0:1788791408.291310:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791409.317073:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791410.345432:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791411.365525:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791412.387614:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791412.519047:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630396288:0@lo:400: 00000100:00100000:3.0:1788791412.519191:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791412.519261:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788791412.519268:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630396416:0@lo:400: 00000100:00100000:3.0:1788791412.519298:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791412.519330:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630396544:0@lo:400: 00000100:00100000:3.0:1788791412.519357:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791412.519378:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788791412.519384:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630396672:0@lo:400: 00000100:00100000:3.0:1788791412.519411:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791412.519447:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630396288 00000100:00100000:3.0:1788791412.519464:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630396288 00000100:00100000:3.0:1788791412.519530:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788791412.519540:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:3314:x1875683630396288:12345-0@lo:400: 00000100:00100000:3.0:1788791412.519599:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:3314:x1875683630396288:12345-0@lo:400: Request processed in 60us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791412.519606:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788791412.519642:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630396416 00000100:00100000:3.0:1788791412.519647:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630396416 00000100:00100000:3.0:1788791412.523538:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630396544 00000100:00100000:3.0:1788791412.523558:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630396544 00000100:00100000:3.0:1788791412.523629:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788791412.523641:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630396416:12345-0@lo:400: 00000100:00080000:1.0:1788791412.524211:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791412.524925:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630396416:12345-0@lo:400: Request processed in 861us (5200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791412.524939:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788791412.524972:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788791412.524984:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630396544:12345-0@lo:400: 00000100:00100000:3.0:1788791412.525037:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630396544:12345-0@lo:400: Request processed in 57us (5678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791412.525044:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788791412.525085:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630396672 00000100:00100000:3.0:1788791412.525092:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630396672 00000100:00100000:3.0:1788791412.525171:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788791412.525179:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630396672:12345-0@lo:400: 00000100:00100000:3.0:1788791412.525215:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630396672:12345-0@lo:400: Request processed in 37us (5802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791412.525221:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788791412.525260:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630396800:0@lo:13: 00000100:00100000:3.0:1788791412.525319:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788791412.525370:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9aba857b8380 x1875683630396416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791412.525388:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630396416:0@lo:400: 00000100:00100000:3.0:1788791412.525402:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630396288:0@lo:400: 00010000:00080000:1.0:1788791412.527399:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9aba857bb100 x1875683630396672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791412.527418:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630396672:0@lo:400: 00010000:00080000:1.0:1788791412.527433:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9aba857bad80 x1875683630396544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791412.527442:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630396544:0@lo:400: 00000100:00100000:3.0:1788791412.527917:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630396800 00000100:00100000:3.0:1788791412.527927:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630396800 00000100:00100000:3.0:1788791412.527994:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788791412.528005:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630396800:12345-0@lo:13: 00002000:00000024:3.0:1788791412.528050:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791412.528164:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630396800:12345-0@lo:13: Request processed in 160us (2844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791412.528171:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788791412.528207:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababc136300 x1875683630396800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791412.528223:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630396800:0@lo:13: 00000100:00080000:3.0:1788791412.528244:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788791413.413976:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791414.442203:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791415.459494:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791416.484399:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791417.507372:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791417.636158:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791417.636183:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630396928:0@lo:13: 00000100:00100000:1.0:1788791417.636259:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791417.636353:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630396928 00000100:00100000:1.0:1788791417.636360:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630396928 00000100:00100000:1.0:1788791417.636417:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788791417.636427:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630396928:12345-0@lo:13: 00002000:00000024:1.0:1788791417.636459:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791417.636511:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc135180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630396928:12345-0@lo:13: Request processed in 85us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791417.636518:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788791417.636561:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788791417.636862:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababc135f80 x1875683630396928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791417.636882:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630396928:0@lo:13: 00000100:00100000:0.0:1788791417.637912:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788791417.637929:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630397312:0@lo:400: 00000100:00100000:0.0:1788791417.637999:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791417.638087:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630397056:0@lo:400: 00000100:00100000:2.0:1788791417.638163:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791417.638193:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788791417.638199:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630397184:0@lo:400: 00000100:00100000:2.0:1788791417.638223:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791417.638882:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630397056 00000100:00100000:0.0:1788791417.638890:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630397056 00000100:00100000:0.0:1788791417.638943:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788791417.638953:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:3312:x1875683630397056:12345-0@lo:400: 00000100:00100000:0.0:1788791417.639007:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:3312:x1875683630397056:12345-0@lo:400: Request processed in 55us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791417.639014:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788791417.639070:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630397056:0@lo:400: 00000100:00100000:0.0:1788791417.639229:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630397312 00000100:00100000:0.0:1788791417.639234:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630397312 00000100:00100000:0.0:1788791417.639269:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630397184 00000100:00100000:0.0:1788791417.639272:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630397184 00000100:00100000:0.0:1788791417.639287:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788791417.639293:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630397312:12345-0@lo:400: 00000100:00100000:0.0:1788791417.639333:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630397312:12345-0@lo:400: Request processed in 41us (1335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791417.639339:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788791417.639359:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788791417.639365:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630397184:12345-0@lo:400: 00000100:00100000:0.0:1788791417.639396:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630397184:12345-0@lo:400: Request processed in 32us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791417.639401:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788791417.639429:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9abab299e300 x1875683630397312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791417.639439:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630397312:0@lo:400: 00010000:00080000:0.0:1788791417.639932:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9abab299c000 x1875683630397184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791417.639943:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630397184:0@lo:400: 00000100:00080000:1.0:1788791417.643597:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:3.0:1788791418.130544:0:7628:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788791418.130549:0:7628:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788791418.130684:0:7628:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9ab9818e0800 00000020:01000004:3.0:1788791418.130700:0:7628:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788791418.130713:0:7628:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788791418.130735:0:7628:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9abab3e399b8) 00000020:00000080:3.0:1788791418.130751:0:7628:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788791418.143743:0:7628:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788791418.143981:0:7628:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788791418.160547:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788791418.164964:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788791418.164987:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788791418.165021:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788791418.165052:0:7628:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788791418.165515:0:7628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788791418.165524:0:7628:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788791418.165533:0:7628:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd6380150a322b7d 00000020:01000004:2.0:1788791418.165538:0:7628:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788791418.165554:0:7628:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788791418.165556:0:7628:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788791418.165560:0:7628:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788791418.165577:0:7628:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788791418.165579:0:7628:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788791418.176102:0:7628:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788791418.176214:0:7628:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.129@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788791418.176218:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788791418.176219:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788791418.176220:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788791418.176221:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788791418.176222:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788791418.176222:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788791418.176223:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788791418.176227:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788791418.176228:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788791418.176229:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788791418.176230:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788791418.176233:0:7628:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788791418.176235:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788791418.176235:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788791418.176236:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788791418.176237:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788791418.176237:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788791418.176238:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788791418.176239:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788791418.176239:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788791418.176240:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788791418.176240:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788791418.176241:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788791418.176342:0:7628:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788791418.176360:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630397440:0@lo:253: 00000100:00100000:3.0:1788791418.176427:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791418.176555:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082600 going to sleep for 11 seconds 00000100:00100000:0.0:1788791418.176596:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630397440 00000100:00100000:0.0:1788791418.176602:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630397440 00000100:00100000:0.0:1788791418.176669:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788791418.176676:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:7628:x1875683630397440:12345-0@lo:253: 20000000:01000000:0.0:1788791418.176698:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788791418.176701:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788791418.176706:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788791418.176708:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788791418.177406:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788791418.177580:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788791418.177593:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788791418.177631:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788791418.177639:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788791418.177667:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788791418.177715:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788791418.177999:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788791418.178012:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.129@tcp 20000000:01000000:0.0:1788791418.178014:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.129@tcp (null) (null) (null) 00000040:00080000:0.0:1788791418.178054:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788791418.178060:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788791418.178100:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788791418.178106:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.129@tcp (null) (null) 00000040:00080000:0.0:1788791418.178153:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788791418.178160:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788791418.178179:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788791418.178205:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788791418.178816:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788791418.178828:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.129@tcp 20000000:01000000:0.0:1788791418.178830:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.129@tcp (null) (null) (null) 00000040:00080000:0.0:1788791418.178849:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788791418.178854:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788791418.178880:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788791418.178888:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.129@tcp (null) (null) 00000040:00080000:0.0:1788791418.178917:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788791418.178924:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788791418.178951:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788791418.178970:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788791418.178979:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788791418.178981:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788791418.178985:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788791418.178986:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788791418.178988:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788791418.178996:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788791418.178997:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788791418.179017:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788791418.179018:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788791418.179620:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788791418.179651:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788791418.179678:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788791418.179929:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788791418.179958:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788791418.179975:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788791418.179982:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788791418.179984:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788791418.180437:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788791418.180468:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1788791418.180519:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788791418.180678:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788791418.180700:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788791418.180740:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788791418.180749:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788791418.180750:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788791418.181071:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788791418.181254:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788791418.181274:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788791418.181302:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788791418.181309:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788791418.181310:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788791418.181709:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788791418.181745:0:7632:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788791418.181761:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788791418.181947:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788791418.181969:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788791418.182005:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:3.0:1788791418.182019:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788791418.182045:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9aba81525000/0xcd6380150a322b84 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.182060:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ad5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322ace expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.182065:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba994ff000/0xcd6380150a322aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322af8 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.182069:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9abac2170a00/0xcd6380150a322b29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322b22 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.182080:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9abac2171000/0xcd6380150a322b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322b3e expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.182085:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9abac2171e00/0xcd6380150a322b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322b68 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.182088:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9aba81525000/0xcd6380150a322b84 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.182118:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9abac2171e00/0xcd6380150a322b6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322b68 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.182213:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9abac2171e00/0xcd6380150a322b6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322b68 expref: 16 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791418.182224:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875683630397568:0@lo:104: 00000100:00100000:3.0:1788791418.182277:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788791418.182357:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9abac2171000/0xcd6380150a322b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322b3e expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.182365:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9abac2171000/0xcd6380150a322b45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322b3e expref: 16 pid: 5830 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791418.182374:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857ba680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875683630397696:0@lo:104: 00010000:00010000:3.0:1788791418.182399:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9abac2170a00/0xcd6380150a322b29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322b22 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.182404:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9abac2170a00/0xcd6380150a322b29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322b22 expref: 16 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791418.182418:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875683630397824:0@lo:104: 00010000:00010000:3.0:1788791418.182434:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba994ff000/0xcd6380150a322aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322af8 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.182439:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9aba994ff000/0xcd6380150a322aff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322af8 expref: 16 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791418.182443:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857bad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875683630397952:0@lo:104: 00010000:00010000:3.0:1788791418.182453:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322ace expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.182457:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ad5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322ace expref: 16 pid: 5830 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791418.182462:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857bb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875683630398080:0@lo:104: 00000100:00100000:3.0:1788791418.182488:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba880826c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791418.182538:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788791418.182552:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791418.182597:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791418.182633:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791418.182646:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630397568 00000100:00100000:3.0:1788791418.182651:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630397568 00000100:00100000:3.0:1788791418.182677:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630397696 00000100:00100000:3.0:1788791418.182678:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630397696 00000100:00100000:3.0:1788791418.182683:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630397824 00000100:00100000:3.0:1788791418.182685:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630397824 00000100:00100000:3.0:1788791418.182692:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788791418.182697:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98033c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+5:5830:x1875683630397568:12345-0@lo:104: 00010000:00010000:3.0:1788791418.182707:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9abac2171600/0xcd6380150a322b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322b6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.182753:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788791418.182762:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98033c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+5:5830:x1875683630397568:12345-0@lo:104: Request processed in 64us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791418.182767:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788791418.182793:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788791418.182796:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+4:5830:x1875683630397696:12345-0@lo:104: 00010000:00010000:3.0:1788791418.182802:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322b45 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.182821:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788791418.182824:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+4:5830:x1875683630397696:12345-0@lo:104: Request processed in 28us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791418.182828:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788791418.182835:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788791418.182838:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:5830:x1875683630397824:12345-0@lo:104: 00010000:00010000:3.0:1788791418.182842:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a322b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322b29 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.182858:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788791418.182862:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:5830:x1875683630397824:12345-0@lo:104: Request processed in 23us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791418.182867:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788791418.182925:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788791418.182930:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abac2171600/0xcd6380150a322b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322b6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.182935:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abac2171600 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791418.182937:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abac2171600/0xcd6380150a322b68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322b6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.182944:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abac2171600/0xcd6380150a322b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322b6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791418.182949:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abac2171600/0xcd6380150a322b68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322b6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791418.182952:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788791418.182986:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abac2171600/0xcd6380150a322b68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322b6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.182991:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791418.183006:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abac2171600/0xcd6380150a322b68 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322b6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183010:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abac2171600/0xcd6380150a322b68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322b6f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183020:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788791418.183032:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322b45 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183036:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abac2170800 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791418.183038:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322b45 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183042:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322b45 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791418.183046:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322b45 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791418.183049:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788791418.183065:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322b3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322b45 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183068:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791418.183079:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322b3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322b45 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183088:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322b3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322b45 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183095:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791418.183096:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a322b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322b29 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183100:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abaa1b5c800 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791418.183102:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a322b22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322b29 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183106:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a322b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322b29 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791418.183109:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a322b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322b29 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791418.183112:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788791418.183119:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a322b22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322b29 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183121:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791418.183144:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a322b22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322b29 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183148:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c800/0xcd6380150a322b22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322b29 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183153:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791418.183158:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791418.183159:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791418.183169:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630398208:0@lo:103: 00000100:00100000:1.0:1788791418.183191:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791418.183215:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630398336:0@lo:103: 00000100:00100000:1.0:1788791418.183227:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791418.183237:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788791418.183240:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630398464:0@lo:103: 00000100:00100000:1.0:1788791418.183250:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791418.183268:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630398208 00000100:00100000:1.0:1788791418.183270:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630398208 00010000:00010000:1.0:1788791418.183284:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9abac2171e00/0xcd6380150a322b6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322b68 expref: 17 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791418.183293:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630398336 00000100:00100000:1.0:1788791418.183295:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630398336 00010000:00010000:1.0:1788791418.183300:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9abac2171000/0xcd6380150a322b45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322b3e expref: 18 pid: 5830 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791418.183305:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630398464 00000100:00100000:1.0:1788791418.183306:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630398464 00010000:00010000:1.0:1788791418.183311:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9abac2170a00/0xcd6380150a322b29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322b22 expref: 19 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791418.183317:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788791418.183321:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc137100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3315:x1875683630398208:12345-0@lo:103: 00010000:00010000:1.0:1788791418.183328:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791418.183331:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9abac2171e00/0xcd6380150a322b6f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322b68 expref: 19 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183349:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9abac2171e00/0xcd6380150a322b6f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322b68 expref: 19 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183363:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791418.183389:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc137100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3315:x1875683630398208:12345-0@lo:103: Request processed in 67us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791418.183396:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788791418.183408:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788791418.183412:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:3312:x1875683630398336:12345-0@lo:103: 00010000:00010000:1.0:1788791418.183417:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791418.183420:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9abac2171000/0xcd6380150a322b45 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322b3e expref: 18 pid: 5830 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183425:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9abac2171000/0xcd6380150a322b45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322b3e expref: 18 pid: 5830 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183432:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791418.183448:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc134380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:3312:x1875683630398336:12345-0@lo:103: Request processed in 37us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791418.183452:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788791418.183458:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788791418.183462:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc136d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:3312:x1875683630398464:12345-0@lo:103: 00010000:00010000:1.0:1788791418.183469:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791418.183472:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9abac2170a00/0xcd6380150a322b29 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322b22 expref: 17 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183480:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9abac2170a00/0xcd6380150a322b29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322b22 expref: 17 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.183497:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791418.183517:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc136d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:3312:x1875683630398464:12345-0@lo:103: Request processed in 54us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791418.183523:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788791418.183551:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630398464:0@lo:103: 00000100:00100000:1.0:1788791418.183556:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630398336:0@lo:103: 00000100:00100000:1.0:1788791418.183570:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630398208:0@lo:103: 00010000:00010000:0.0:1788791418.183621:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791418.183636:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abac2171e00/0xcd6380150a322b6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322b68 expref: 16 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791418.183647:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875683630397568:0@lo:104: 00010000:00010000:0.0:1788791418.183654:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abac2171000/0xcd6380150a322b45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322b3e expref: 15 pid: 5830 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791418.183659:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857ba680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875683630397696:0@lo:104: 00010000:00010000:0.0:1788791418.183663:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abac2170a00/0xcd6380150a322b29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322b22 expref: 14 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791418.183667:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875683630397824:0@lo:104: 00000100:00100000:2.0:1788791418.183781:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791418.183823:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630397952 00000100:00100000:3.0:1788791418.183825:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630397952 00000100:00100000:3.0:1788791418.183838:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630398080 00000100:00100000:3.0:1788791418.183839:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630398080 00000100:00100000:3.0:1788791418.183845:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788791418.183848:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+4:5830:x1875683630397952:12345-0@lo:104: 00010000:00010000:3.0:1788791418.183855:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322aff expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.183910:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788791418.183916:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+4:5830:x1875683630397952:12345-0@lo:104: Request processed in 66us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791418.183921:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788791418.183931:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788791418.183935:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:5830:x1875683630398080:12345-0@lo:104: 00010000:00010000:3.0:1788791418.183940:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c200/0xcd6380150a322ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322ad5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.183960:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788791418.183962:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:5830:x1875683630398080:12345-0@lo:104: Request processed in 28us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791418.183966:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788791418.184002:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788791418.184005:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322aff expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.184010:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe600 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791418.184011:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322aff expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.184016:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322aff expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791418.184020:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322aff expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791418.184033:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788791418.184064:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322af8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322aff expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.184070:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788791418.184091:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322af8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322aff expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.184098:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322af8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322aff expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791418.184106:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630398592:0@lo:103: 00010000:00010000:0.0:1788791418.184109:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791418.184111:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c200/0xcd6380150a322ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322ad5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.184117:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abaa1b5c200 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791418.184119:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c200/0xcd6380150a322ace lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322ad5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.184142:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c200/0xcd6380150a322ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322ad5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791418.184149:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1788791418.184149:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c200/0xcd6380150a322ace lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322ad5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791418.184155:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788791418.184168:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c200/0xcd6380150a322ace lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322ad5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.184173:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788791418.184185:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c200/0xcd6380150a322ace lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322ad5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791418.184192:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788791418.184192:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c200/0xcd6380150a322ace lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322ad5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791418.184197:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630398720:0@lo:103: 00010000:00010000:0.0:1788791418.184204:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791418.184210:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791418.184212:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791418.184218:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791418.184228:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857bad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875683630397952:0@lo:104: 00000100:00100000:0.0:1788791418.184236:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857bb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5830:1875683630398080:0@lo:104: 00010000:00010000:0.0:1788791418.184255:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9aba81525000/0xcd6380150a322b84 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791418.184339:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630398592 00000100:00100000:1.0:1788791418.184344:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630398592 00010000:00010000:1.0:1788791418.184359:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba994ff000/0xcd6380150a322aff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322af8 expref: 14 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791418.184418:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630398720 00000100:00100000:1.0:1788791418.184422:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630398720 00010000:00010000:1.0:1788791418.184434:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ad5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322ace expref: 15 pid: 5830 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791418.184462:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788791418.184469:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:3314:x1875683630398592:12345-0@lo:103: 00010000:00010000:3.0:1788791418.184477:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791418.184483:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba994ff000/0xcd6380150a322aff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322af8 expref: 15 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.184492:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba994ff000/0xcd6380150a322aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322af8 expref: 15 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.184502:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994ff000/0xcd6380150a322aff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322af8 expref: 15 pid: 5832 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.184512:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791418.184542:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:3314:x1875683630398592:12345-0@lo:103: Request processed in 74us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791418.184556:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788791418.184569:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788791418.184569:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630398592:0@lo:103: 00000100:00100000:3.0:1788791418.184574:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:3314:x1875683630398720:12345-0@lo:103: 00010000:00010000:3.0:1788791418.184581:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791418.184585:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ad5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322ace expref: 13 pid: 5830 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.184593:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322ace expref: 13 pid: 5830 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.184604:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ad5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322ace expref: 13 pid: 5830 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.184614:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9aba81525000/0xcd6380150a322b84 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.184622:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba81525000/0xcd6380150a322b84 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.184634:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9aba81525000/0xcd6380150a322b84 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.184640:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9aba81525000/0xcd6380150a322b84 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.184647:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9aba81525000/0xcd6380150a322b84 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.184651:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9aba81525000/0xcd6380150a322b84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.184661:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81525000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791418.184664:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9aba81525000/0xcd6380150a322b84 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.184669:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9aba81525000/0xcd6380150a322b84 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.184683:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9aba81525000/0xcd6380150a322b84 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.184689:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791418.184711:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:3314:x1875683630398720:12345-0@lo:103: Request processed in 137us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791418.184717:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788791418.184738:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630398720:0@lo:103: 00010000:00010000:0.0:1788791418.184760:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9aba81525000/0xcd6380150a322b84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.184768:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9aba81525000/0xcd6380150a322b84 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.184775:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba81525000/0xcd6380150a322b84 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788791418.184787:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:1.0:1788791418.184959:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791418.205391:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:7628:x1875683630397440:12345-0@lo:253: Request processed in 28706us (28954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791418.205405:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788791418.205418:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630397440:0@lo:253: 10000000:01000000:3.0:1788791418.205433:0:7628:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788791418.205436:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788791418.205437:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788791418.205439:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788791418.205440:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788791418.205442:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788791418.205443:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788791418.205444:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788791418.205446:0:7628:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788791418.205447:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788791418.205449:0:7628:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788791418.205468:0:7628:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9ab9818e0800 from lustre-OST0001 10000000:01000000:3.0:1788791418.205490:0:7628:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788791418.205492:0:7628:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788791418.205499:0:7628:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9aba88c60000 local copy 10000000:01000000:3.0:1788791418.205504:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788791418.205546:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322b8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.205554:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322b8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.205560:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322b8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791418.205571:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630398848:0@lo:101: 00000100:00100000:3.0:1788791418.205599:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791418.205629:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082180 going to sleep for 11 seconds 00000100:00100000:2.0:1788791418.205638:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630398848 00000100:00100000:2.0:1788791418.205645:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630398848 00000100:00100000:2.0:1788791418.205690:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788791418.205698:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+11:7628:x1875683630398848:12345-0@lo:101: 00010000:00010000:2.0:1788791418.205711:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791418.205724:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abac2170c00/0xcd6380150a322b92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322b8b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791418.205744:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abac2170c00/0xcd6380150a322b92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322b8b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791418.205751:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abac2170c00/0xcd6380150a322b92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322b8b expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791418.205758:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abac2170c00, rc 0) 00000100:00100000:2.0:1788791418.205785:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:7628:x1875683630398848:12345-0@lo:101: Request processed in 88us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791418.205791:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788791418.205811:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630398848:0@lo:101: 00010000:00010000:3.0:1788791418.205823:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322b8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcd6380150a322b92 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.205833:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322b8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd6380150a322b92 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791418.205917:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630398976:0@lo:501: 00000100:00100000:3.0:1788791418.205939:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791418.205954:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082180 going to sleep for 11 seconds 00000100:00100000:2.0:1788791418.205975:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630398976 00000100:00100000:2.0:1788791418.205979:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630398976 00000100:00100000:2.0:1788791418.206000:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788791418.206006:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:7628:x1875683630398976:12345-0@lo:501: 00000100:00100000:3.0:1788791418.206282:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:7628:x1875683630398976:12345-0@lo:501: Request processed in 275us (340us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788791418.206289:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788791418.206298:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630398976:0@lo:501: 10000000:01000000:2.0:1788791418.206310:0:7628:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788791418.206332:0:7628:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788791418.206337:0:7628:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322b8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd6380150a322b92 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791418.206345:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322b8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd6380150a322b92 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791418.206363:0:7628:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd6380150a322b92 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791418.206411:0:7628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788791418.206425:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9ab9818e0800 10000000:01000000:2.0:1788791418.206428:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788791418.206431:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788791418.206433:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788791418.206436:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788791418.206437:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788791418.206459:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322b99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791418.206464:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322b99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791418.206469:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322b99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791418.206476:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630399104:0@lo:101: 00000100:00100000:2.0:1788791418.206495:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791418.206517:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1788791418.206533:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630399104 00000100:00100000:3.0:1788791418.206537:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630399104 00010000:00010000:0.0:1788791418.206553:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791418.206560:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd6380150a322b92 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791418.206568:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00010000:00010000:0.0:1788791418.206568:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81524600 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791418.206571:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322b8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd6380150a322b92 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791418.206574:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:7628:x1875683630399104:12345-0@lo:101: 00010000:00010000:0.0:1788791418.206580:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcd6380150a322b92 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791418.206587:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322b8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcd6380150a322b92 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.206588:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791418.206597:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba81524e00/0xcd6380150a322ba0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322b99 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791418.206602:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788791418.206610:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba81524e00/0xcd6380150a322ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322b99 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.206617:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba81524e00/0xcd6380150a322ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322b99 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.206618:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322b8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd6380150a322b92 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.206624:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788791418.206625:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba81524e00, rc 0) 00000100:00100000:3.0:1788791418.206650:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:7628:x1875683630399104:12345-0@lo:101: Request processed in 76us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791418.206657:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788791418.206672:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630399232:0@lo:103: 00000100:00100000:2.0:1788791418.206699:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788791418.206743:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322b8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd6380150a322b92 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791418.206744:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630399232 00000100:00100000:3.0:1788791418.206748:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630399232 00010000:00010000:0.0:1788791418.206751:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322b8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd6380150a322b92 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.206763:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791418.206765:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791418.206767:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791418.206772:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788791418.206779:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86259880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:3312:x1875683630399232:12345-0@lo:103: 00010000:00010000:3.0:1788791418.206788:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791418.206798:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abac2170c00/0xcd6380150a322b92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a322b8b expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.206807:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791418.206810:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630399104:0@lo:101: 00010000:00010000:2.0:1788791418.206820:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322b99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ba0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791418.206837:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322b99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322ba0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791418.206882:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86259880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:3312:x1875683630399232:12345-0@lo:103: Request processed in 103us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791418.206889:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788791418.206962:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630399232:0@lo:103: 00000100:00100000:2.0:1788791418.206982:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630399360:0@lo:501: 00000100:00100000:2.0:1788791418.207005:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791418.207068:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1788791418.207101:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630399360 00000100:00100000:3.0:1788791418.207104:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630399360 00000100:00100000:3.0:1788791418.207177:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788791418.207189:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:7628:x1875683630399360:12345-0@lo:501: 00000100:00100000:3.0:1788791418.207333:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:7628:x1875683630399360:12345-0@lo:501: Request processed in 145us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791418.207340:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788791418.207362:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630399360:0@lo:501: 00000100:00100000:0.0:1788791418.207387:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630399488:0@lo:503: 00000100:00100000:0.0:1788791418.207423:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791418.207476:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916c5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788791418.207553:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630399488 00000100:00100000:1.0:1788791418.207558:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630399488 00000100:00100000:1.0:1788791418.207624:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788791418.207630:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:7628:x1875683630399488:12345-0@lo:503: 00000100:00100000:1.0:1788791418.207742:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:7628:x1875683630399488:12345-0@lo:503: Request processed in 108us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791418.207749:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788791418.207767:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630399488:0@lo:503: 00000040:00080000:0.0:1788791418.208087:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788791418.208208:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630399616:0@lo:502: 00000100:00100000:0.0:1788791418.208234:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791418.208255:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916c5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791418.208265:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630399616 00000100:00100000:3.0:1788791418.208268:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630399616 00000100:00100000:3.0:1788791418.208297:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788791418.208304:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:7628:x1875683630399616:12345-0@lo:502: 00000100:00100000:3.0:1788791418.208461:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:7628:x1875683630399616:12345-0@lo:502: Request processed in 157us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791418.208468:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788791418.208486:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630399616:0@lo:502: 00000040:00080000:0.0:1788791418.208663:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788791418.208698:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788791418.208715:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788791418.208747:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788791418.208769:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788791418.208785:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788791418.208799:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630399744:0@lo:502: 00000100:00100000:0.0:1788791418.208823:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791418.208839:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916c5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788791418.208859:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630399744 00000100:00100000:1.0:1788791418.208863:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630399744 00000100:00100000:1.0:1788791418.208903:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788791418.208910:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:7628:x1875683630399744:12345-0@lo:502: 00000100:00100000:1.0:1788791418.209041:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:7628:x1875683630399744:12345-0@lo:502: Request processed in 130us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791418.209047:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788791418.209051:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630399744:0@lo:502: 00000040:00080000:0.0:1788791418.209115:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788791418.209267:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788791418.209698:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788791418.209705:0:7634:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788791418.209711:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791418.209713:0:7634:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788791418.209717:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788791418.209735:0:7634:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ababb06cd28) 00000020:00000080:0.0:1788791418.209754:0:7634:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788791418.209760:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788791418.209801:0:7634:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ab9818e0800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788791418.209805:0:7634:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788791418.209810:0:7634:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd6380150a322bae 00010000:00010000:0.0:1788791418.212426:0:7634:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788791418.212669:0:7634:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788791418.214233:0:7634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788791418.214736:0:7634:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788791418.216925:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788791418.217625:0:7634:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788791418.218557:0:7634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788791418.218568:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791418.218580:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791418.218582:0:7634:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788791418.218588:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791418.218592:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791418.218593:0:7634:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788791418.218596:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788791418.218598:0:7634:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788791418.218639:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791418.218642:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791418.218643:0:7634:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788791418.218646:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788791418.218814:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788791418.218839:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788791418.218894:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322b99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ba0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.218905:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322b99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ba0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791418.218914:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ab9818e0800 from 1 10000000:01000000:3.0:1788791418.218917:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788791418.218946:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba81525c00/0xcd6380150a322bb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.218954:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba81525c00/0xcd6380150a322bb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791418.218964:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba81525c00/0xcd6380150a322bb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791418.218994:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630399872:0@lo:101: 00000100:00100000:3.0:1788791418.219073:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791418.219118:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082840 going to sleep for 11 seconds 00000100:00100000:1.0:1788791418.219201:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630399872 00000100:00100000:1.0:1788791418.219209:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630399872 00000100:00100000:1.0:1788791418.219259:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788791418.219268:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:7628:x1875683630399872:12345-0@lo:101: 00010000:00010000:1.0:1788791418.219281:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791418.219293:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322bbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322bb5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.219314:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322bbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322bb5 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.219324:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322bbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322bb5 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.219407:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abaa1b5c800, rc 0) 00000100:00100000:1.0:1788791418.219449:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:7628:x1875683630399872:12345-0@lo:101: Request processed in 182us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791418.219456:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788791418.219493:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630399872:0@lo:101: 00010000:00010000:1.0:1788791418.219507:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba81525c00/0xcd6380150a322bb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322bbc expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.219515:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba81525c00/0xcd6380150a322bb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322bbc expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791418.219595:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630400000:0@lo:501: 00000100:00100000:1.0:1788791418.219620:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791418.219634:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae030c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791418.219648:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630400000 00000100:00100000:1.0:1788791418.219652:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630400000 00000100:00100000:1.0:1788791418.219669:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788791418.219674:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:7628:x1875683630400000:12345-0@lo:501: 00000100:00100000:1.0:1788791418.219854:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:7628:x1875683630400000:12345-0@lo:501: Request processed in 178us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791418.219861:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788791418.219890:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630400000:0@lo:501: 00000100:00100000:1.0:1788791418.219915:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630400128:0@lo:503: 00000100:00100000:1.0:1788791418.219949:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791418.219961:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae030c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791418.219973:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630400128 00000100:00100000:1.0:1788791418.219976:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630400128 00000100:00100000:1.0:1788791418.219994:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788791418.220000:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:7628:x1875683630400128:12345-0@lo:503: 00000100:00100000:1.0:1788791418.220288:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:7628:x1875683630400128:12345-0@lo:503: Request processed in 287us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791418.220295:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788791418.220330:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630400128:0@lo:503: 00000040:00080000:1.0:1788791418.220794:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788791418.220847:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630400256:0@lo:502: 00000100:00100000:1.0:1788791418.220889:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791418.220959:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae030c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791418.220981:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630400256 00000100:00100000:1.0:1788791418.220986:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630400256 00000100:00100000:0.0:1788791418.221046:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788791418.221055:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:7628:x1875683630400256:12345-0@lo:502: 00000100:00100000:0.0:1788791418.221242:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:7628:x1875683630400256:12345-0@lo:502: Request processed in 188us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791418.221249:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788791418.221364:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630400256:0@lo:502: 00000040:00080000:3.0:1788791418.221608:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788791418.221657:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788791418.221682:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630400384:0@lo:502: 00000100:00100000:3.0:1788791418.221717:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791418.221750:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba880826c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791418.221876:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630400384 00000100:00100000:0.0:1788791418.221881:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630400384 00000100:00100000:0.0:1788791418.221917:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788791418.221924:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:7628:x1875683630400384:12345-0@lo:502: 00000100:00100000:0.0:1788791418.222053:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:7628:x1875683630400384:12345-0@lo:502: Request processed in 129us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791418.222060:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788791418.222162:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630400384:0@lo:502: 00000040:00080000:3.0:1788791418.222237:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788791418.222247:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788791418.223123:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791418.223240:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791418.223243:0:7638:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788791418.223249:0:7638:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ab9818e0800 00000020:00000080:3.0:1788791418.223251:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788791418.223271:0:7638:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791418.223274:0:7638:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791418.223275:0:7638:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788791418.223278:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788791418.223451:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788791418.223469:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788791418.223515:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba81525c00/0xcd6380150a322bb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322bbc expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.223525:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba81525c00/0xcd6380150a322bb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322bbc expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791418.223570:0:7628:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788791418.223572:0:7628:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9ab9818e0800 10000000:01000000:0.0:1788791418.223575:0:7628:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9ab9818e0800 10000000:01000000:0.0:1788791418.223579:0:7628:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788791418.223584:0:7628:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ab9818e0800 from 1 10000000:01000000:0.0:1788791418.223587:0:7628:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788791418.223613:0:7628:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322bc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.223621:0:7628:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322bc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.223630:0:7628:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322bc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791418.223644:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630400512:0@lo:101: 00000100:00100000:0.0:1788791418.223680:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791418.223715:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916c5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788791418.223765:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630400512 00000100:00100000:1.0:1788791418.223771:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630400512 00000100:00100000:1.0:1788791418.223808:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788791418.223816:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:7628:x1875683630400512:12345-0@lo:101: 00010000:00010000:1.0:1788791418.223826:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791418.223836:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322bca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322bc3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.223856:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322bc3 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.223866:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322bc3 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.223875:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abaa1b5c600, rc 0) 00000100:00100000:1.0:1788791418.223905:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:7628:x1875683630400512:12345-0@lo:101: Request processed in 90us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791418.223911:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788791418.223983:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630400512:0@lo:101: 00010000:00010000:0.0:1788791418.223997:0:7628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322bc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322bca expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.224006:0:7628:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322bc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322bca expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791418.224083:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630400640:0@lo:501: 00000100:00100000:0.0:1788791418.224107:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791418.224160:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916c5600 going to sleep for 11 seconds 00000100:00100000:2.0:1788791418.224165:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630400640 00000100:00100000:2.0:1788791418.224169:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630400640 00000100:00100000:2.0:1788791418.224198:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788791418.224205:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:7628:x1875683630400640:12345-0@lo:501: 00000100:00100000:2.0:1788791418.224383:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:7628:x1875683630400640:12345-0@lo:501: Request processed in 177us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791418.224390:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788791418.224579:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630400640:0@lo:501: 00000100:00100000:0.0:1788791418.224601:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630400768:0@lo:503: 00000100:00100000:0.0:1788791418.224627:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791418.224644:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916c5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788791418.224673:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630400768 00000100:00100000:1.0:1788791418.224677:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630400768 00000100:00100000:1.0:1788791418.224699:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788791418.224705:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:7628:x1875683630400768:12345-0@lo:503: 00000100:00100000:1.0:1788791418.224828:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:7628:x1875683630400768:12345-0@lo:503: Request processed in 123us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791418.224832:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788791418.224897:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630400768:0@lo:503: 00000040:00080000:0.0:1788791418.225105:0:7628:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788791418.225277:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630400896:0@lo:502: 00000100:00100000:0.0:1788791418.225300:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791418.225350:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916c5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788791418.225412:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630400896 00000100:00100000:1.0:1788791418.225416:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630400896 00000100:00100000:1.0:1788791418.225437:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788791418.225444:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:7628:x1875683630400896:12345-0@lo:502: 00000100:00100000:1.0:1788791418.225593:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:7628:x1875683630400896:12345-0@lo:502: Request processed in 150us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791418.225598:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788791418.225640:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630400896:0@lo:502: 00000040:00080000:0.0:1788791418.225795:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788791418.225826:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788791418.225844:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788791418.225881:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788791418.225919:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788791418.225952:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788791418.225970:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788791418.225987:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788791418.226036:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788791418.226073:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788791418.226107:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788791418.226290:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788791418.226317:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788791418.226393:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788791418.226426:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788791418.226445:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788791418.226462:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788791418.226485:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788791418.226514:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788791418.226531:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788791418.226565:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788791418.226588:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788791418.226606:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788791418.226629:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788791418.226646:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788791418.226662:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788791418.226698:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788791418.226718:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1788791418.226735:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788791418.226767:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1788791418.226789:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1788791418.226805:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1788791418.226822:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1788791418.226845:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1788791418.226871:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1788791418.226927:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1788791418.226953:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1788791418.226977:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630401024:0@lo:502: 00000100:00100000:0.0:1788791418.227032:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791418.227101:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916c5600 going to sleep for 11 seconds 00000100:00100000:1.0:1788791418.227214:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630401024 00000100:00100000:1.0:1788791418.227219:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630401024 00000100:00100000:1.0:1788791418.227249:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788791418.227258:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:7628:x1875683630401024:12345-0@lo:502: 00000100:00100000:1.0:1788791418.227483:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:7628:x1875683630401024:12345-0@lo:502: Request processed in 227us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791418.227488:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788791418.227539:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630401024:0@lo:502: 00000040:00080000:0.0:1788791418.227588:0:7628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788791418.227595:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788791418.228218:0:7639:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788791418.228241:0:7639:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9abab3063370) 00000020:00000080:2.0:1788791418.228262:0:7639:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788791418.228332:0:7639:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9ab9818e0800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788791418.228337:0:7639:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ab9818e0800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788791418.228339:0:7639:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ab9818e0800 3 00010000:00080000:2.0:1788791418.228365:0:7639:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9abab3069800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1788791418.229892:0:7639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788791418.230121:0:7639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788791418.230250:0:7639:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788791418.230260:0:7639:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcd6380150a322bd8 00000100:00080000:2.0:1788791418.230267:0:7639:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788791418.230271:0:7639:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9abab3069800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788791418.230297:0:7639:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9aba86259500 x1875683630401152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788791418.230344:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba86259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875683630401152:0@lo:38: 00000100:00100000:3.0:1788791418.230395:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788791418.230441:0:7639:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788791418.230535:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630401152 00000100:00100000:0.0:1788791418.230541:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630401152 00000100:00100000:0.0:1788791418.230577:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788791418.230585:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1875683630401152:12345-0@lo:38: 00010000:00080000:0.0:1788791418.230606:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:0.0:1788791418.230639:0:5837:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcd6380150a322bdf 00000004:00100000:0.0:1788791418.230651:0:5837:0:(mdt_handler.c:7335:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788791418.230678:0:5837:0:(import.c:65:import_set_state_nolock()) ffff9ab98126e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788791418.233665:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875683630401152:12345-0@lo:38: Request processed in 3073us (3262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791418.233676:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788791418.234109:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9aba86259500 x1875683630401152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788791428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791418.234121:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788791418.234151:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788791418.234160:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788791418.234164:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788791418.234168:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9abab3069800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788791418.234176:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba86259500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875683630401152:0@lo:38: 00000100:00100000:2.0:1788791418.234326:0:7640:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba86258e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7640:1875683630401280:0@lo:901: 00000040:00080000:3.0:1788791418.234385:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1788791418.234391:0:7640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791418.234420:0:7640:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788791418.234526:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630401280 00000100:00100000:0.0:1788791418.234532:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630401280 00000100:00100000:0.0:1788791418.234590:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788791418.234599:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8625b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7640:x1875683630401280:12345-0@lo:901: 00000100:00100000:0.0:1788791418.234893:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8625b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7640:x1875683630401280:12345-0@lo:901: Request processed in 295us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791418.234901:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:0.0:1788791418.234923:0:7628:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00010000:00080000:3.0:1788791418.234948:0:7640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9aba86258e00 x1875683630401280/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788791434 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788791418.234950:0:7628:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:3.0:1788791418.234958:0:7640:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba86258e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7640:1875683630401280:0@lo:901: 00010000:00010000:0.0:1788791418.234970:0:7628:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322bc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322bca expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.234979:0:7628:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322bc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322bca expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788791418.235032:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788791418.235035:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788791418.235036:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791418.235038:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791418.235039:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791418.235040:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791418.235042:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788791418.235044:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788791418.235045:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788791418.235047:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791418.235053:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788791418.235056:0:7628:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788791418.235059:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788791418.235060:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788791418.235061:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791418.235062:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791418.235063:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791418.235064:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791418.235065:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788791418.235066:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788791418.235067:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788791418.235068:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791418.235069:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788791418.235085:0:7628:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788791418.235094:0:7628:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630401408:0@lo:253: 00000100:00100000:0.0:1788791418.235158:0:7628:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791418.235179:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630401408 00000100:00100000:0.0:1788791418.235182:0:7628:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916c59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791418.235183:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630401408 00000100:00100000:3.0:1788791418.235218:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788791418.235225:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:7628:x1875683630401408:12345-0@lo:253: 00000100:00080000:2.0:1788791418.235230:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:3.0:1788791418.235244:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788791418.235257:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788791418.247643:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788791418.247663:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788791418.247760:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788791418.247765:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788791418.247784:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9abac2170c00/0xcd6380150a322be6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791418.247801:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9abac2171200/0xcd6380150a322b37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322b30 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791418.247810:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9abac2170c00/0xcd6380150a322be6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791418.247848:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9abac2171200/0xcd6380150a322b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322b30 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791418.247862:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9abac2171200/0xcd6380150a322b37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322b30 expref: 14 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791418.247877:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba86258700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875683630401536:0@lo:104: 00000100:00100000:2.0:1788791418.247941:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791418.247982:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba86039780 going to sleep for 11 seconds 00000100:00100000:0.0:1788791418.248046:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630401536 00000100:00100000:0.0:1788791418.248054:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630401536 00000100:00100000:0.0:1788791418.248100:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788791418.248107:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86258a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:5853:x1875683630401536:12345-0@lo:104: 00010000:00010000:0.0:1788791418.248117:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322b37 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.248188:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788791418.248194:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86258a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:5853:x1875683630401536:12345-0@lo:104: Request processed in 88us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791418.248200:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba86258700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875683630401536:0@lo:104: 00000100:00100000:0.0:1788791418.248201:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788791418.248219:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9abac2170c00/0xcd6380150a322be6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.248234:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791418.248239:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322b37 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.248246:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abaa1b5ca00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791418.248249:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322b30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322b37 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.248257:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322b37 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791418.248275:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322b30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322b37 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791418.248281:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788791418.248357:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322b30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322b37 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.248364:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791418.248389:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322b30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322b37 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.248396:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322b30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322b37 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.248412:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791418.248414:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791418.248415:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791418.248422:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788791418.248432:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630401664:0@lo:103: 00000100:00100000:1.0:1788791418.248473:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791418.248508:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630401664 00000100:00100000:0.0:1788791418.248513:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630401664 00010000:00010000:0.0:1788791418.248528:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9abac2171200/0xcd6380150a322b37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322b30 expref: 15 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791418.248551:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788791418.248564:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba856ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:3312:x1875683630401664:12345-0@lo:103: 00010000:00010000:0.0:1788791418.248574:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791418.248579:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9abac2171200/0xcd6380150a322b37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322b30 expref: 15 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.248589:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9abac2171200/0xcd6380150a322b37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322b30 expref: 15 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.248601:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abac2171200/0xcd6380150a322b37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322b30 expref: 15 pid: 5831 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.248613:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9abac2170c00/0xcd6380150a322be6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.248620:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abac2170c00/0xcd6380150a322be6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788791418.248628:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011361735s 00010000:00010000:0.0:1788791418.248631:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9abac2170c00/0xcd6380150a322be6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.248635:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9abac2170c00/0xcd6380150a322be6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.248639:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9abac2170c00/0xcd6380150a322be6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.248643:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9abac2170c00/0xcd6380150a322be6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.248646:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abac2170c00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791418.248654:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9abac2170c00/0xcd6380150a322be6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.248659:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9abac2170c00/0xcd6380150a322be6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.248672:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9abac2170c00/0xcd6380150a322be6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791418.248681:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788791418.248689:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9abac2170c00/0xcd6380150a322be6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.248696:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9abac2170c00/0xcd6380150a322be6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791418.248703:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abac2170c00/0xcd6380150a322be6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791418.248708:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba856ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:3312:x1875683630401664:12345-0@lo:103: Request processed in 145us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791418.248714:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788791418.248726:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630401664:0@lo:103: 00000100:00100000:1.0:1788791418.251988:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:7628:x1875683630401408:12345-0@lo:253: Request processed in 16754us (16851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791418.252011:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788791418.252011:0:7628:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9967ad2d-016f-4163-8b2b-d5dc380f4403:7628:1875683630401408:0@lo:253: 10000000:01000000:0.0:1788791418.252037:0:7628:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788791418.252041:0:7628:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788791418.252043:0:7628:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788791418.252044:0:7628:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791418.252045:0:7628:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791418.252046:0:7628:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791418.252047:0:7628:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791418.252049:0:7628:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788791418.252050:0:7628:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788791418.252052:0:7628:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788791418.252053:0:7628:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791418.252054:0:7628:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788791418.252070:0:7628:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788791418.255074:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788791418.255425:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788791418.255596:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788791418.255715:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788791418.255839:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788791418.256047:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788791418.256824:0:7628:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788791418.412170:0:7628:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788791418.412176:0:7628:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788791418.412209:0:7628:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788791418.412256:0:7628:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788791418.412269:0:7628:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788791418.412289:0:7628:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788791418.535526:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791419.558881:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791420.591700:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791421.624060:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791422.630093:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791422.755831:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630401792:0@lo:13: 00000100:00100000:3.0:1788791422.755905:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791422.756274:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630401792 00000100:00100000:1.0:1788791422.756283:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630401792 00000100:00100000:1.0:1788791422.756335:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788791422.756344:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630401792:12345-0@lo:13: 00002000:00000024:1.0:1788791422.756404:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791422.756458:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630401792:12345-0@lo:13: Request processed in 115us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791422.756466:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788791422.756488:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788791422.756712:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababc136680 x1875683630401792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791422.756730:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc136680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630401792:0@lo:13: 00000100:00100000:0.0:1788791423.268305:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630401920:0@lo:400: 00000100:00100000:3.0:1788791423.268337:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630402176:0@lo:400: 00000100:00100000:0.0:1788791423.268380:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791423.274099:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630402304:0@lo:400: 00000100:00100000:3.0:1788791423.279327:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791423.279460:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630402176 00000100:00100000:3.0:1788791423.279469:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630402176 00000100:00100000:3.0:1788791423.279530:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788791423.279540:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630402176:12345-0@lo:400: 00000100:00100000:3.0:1788791423.279632:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630402176:12345-0@lo:400: Request processed in 93us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791423.279639:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788791423.279660:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788791423.279807:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299f480 x1875683630402176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791423.279822:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630402176:0@lo:400: 00000100:00100000:3.0:1788791423.279841:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788791423.279863:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630402048:0@lo:400: 00000100:00100000:3.0:1788791423.279896:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791423.279924:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630402048 00000100:00100000:3.0:1788791423.279928:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630402048 00000100:00100000:3.0:1788791423.279961:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788791423.279967:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630402048:12345-0@lo:400: 00000100:00100000:3.0:1788791423.280002:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630402048:12345-0@lo:400: Request processed in 35us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791423.280008:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788791423.280033:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299dc00 x1875683630402048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791423.280043:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630402048:0@lo:400: 00000100:00100000:0.0:1788791423.280273:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630401920 00000100:00100000:0.0:1788791423.280280:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630401920 00000100:00100000:0.0:1788791423.280309:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788791423.280316:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:3315:x1875683630401920:12345-0@lo:400: 00000100:00100000:0.0:1788791423.280353:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:3315:x1875683630401920:12345-0@lo:400: Request processed in 38us (11978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791423.280358:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788791423.280390:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630401920:0@lo:400: 00000100:00100000:1.0:1788791423.280625:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791423.280700:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630402304 00000100:00100000:2.0:1788791423.280704:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630402304 00000100:00100000:2.0:1788791423.280745:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788791423.280752:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630402304:12345-0@lo:400: 00000100:00080000:1.0:1788791423.280843:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791423.281095:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630402304:12345-0@lo:400: Request processed in 342us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791423.281102:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788791423.281173:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299f100 x1875683630402304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791423.281183:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630402304:0@lo:400: 00010000:00010000:0.0:1788791423.651462:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791424.679771:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791425.706462:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791426.726297:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788791426.856859:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788791426.856868:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ababbc61000 from 30 10000000:01000000:3.0:1788791426.856884:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788791426.856932:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791426.856946:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791426.856967:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791426.856992:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630402432:0@lo:101: 00000100:00100000:3.0:1788791426.857068:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791426.857111:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8807c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788791426.858144:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630402432 00000100:00100000:1.0:1788791426.858154:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630402432 00000100:00100000:1.0:1788791426.858225:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788791426.858235:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:5834:x1875683630402432:12345-0@lo:101: 00010000:00010000:1.0:1788791426.858257:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791426.858280:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abaa1b5d800/0xcd6380150a322bf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322bed expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791426.858306:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abaa1b5d800/0xcd6380150a322bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322bed expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791426.858316:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abaa1b5d800/0xcd6380150a322bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322bed expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791426.858324:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abaa1b5d800, rc 0) 00000100:00100000:1.0:1788791426.858382:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:5834:x1875683630402432:12345-0@lo:101: Request processed in 148us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791426.858389:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788791426.858576:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630402432:0@lo:101: 00010000:00010000:3.0:1788791426.858593:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322bed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322bf4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791426.858603:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322bed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322bf4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791426.858661:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630402560:0@lo:501: 00000100:00100000:3.0:1788791426.858693:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791426.858738:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8807c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788791426.858768:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630402560 00000100:00100000:0.0:1788791426.858774:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630402560 00000100:00100000:0.0:1788791426.858803:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788791426.858810:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:5834:x1875683630402560:12345-0@lo:501: 00000100:00100000:0.0:1788791426.859455:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:5834:x1875683630402560:12345-0@lo:501: Request processed in 644us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791426.859463:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788791426.859698:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630402560:0@lo:501: 00000100:00100000:3.0:1788791426.859735:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630402688:0@lo:503: 00000100:00100000:3.0:1788791426.859800:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791426.859836:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8807c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788791426.861602:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630402688 00000100:00100000:0.0:1788791426.861614:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630402688 00000100:00100000:0.0:1788791426.861672:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788791426.861683:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:5834:x1875683630402688:12345-0@lo:503: 00000100:00100000:0.0:1788791426.862417:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:5834:x1875683630402688:12345-0@lo:503: Request processed in 734us (2615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791426.862425:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788791426.862582:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630402688:0@lo:503: 00000100:00100000:1.0:1788791426.862771:0:7968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc137480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:7968:1875683630402816:0@lo:502: 00000100:00100000:1.0:1788791426.862828:0:7968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791426.862856:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630402816 00000100:00100000:1.0:1788791426.862860:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630402816 00000100:00100000:1.0:1788791426.862917:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788791426.862925:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:7968:x1875683630402816:12345-0@lo:502: 00000100:00100000:1.0:1788791426.864175:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:7968:x1875683630402816:12345-0@lo:502: Request processed in 1246us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791426.865070:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788791426.873700:0:7968:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788791426.873749:0:7968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc137480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:7968:1875683630402816:0@lo:502: 00000100:00100000:0.0:1788791426.873922:0:7968:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:7968:1875683630402944:0@lo:502: 00000100:00100000:0.0:1788791426.874013:0:7968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791426.874063:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630402944 00000100:00100000:0.0:1788791426.874070:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630402944 00000100:00100000:0.0:1788791426.874121:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788791426.874149:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:7968:x1875683630402944:12345-0@lo:502: 00000100:00100000:0.0:1788791426.877520:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:7968:x1875683630402944:12345-0@lo:502: Request processed in 3362us (3497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791426.877604:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788791426.877690:0:7968:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9921a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788791426.877716:0:7968:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:7968:1875683630402944:0@lo:502: 00000040:00080000:0.0:1788791426.877753:0:7968:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788791426.883106:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788791426.883156:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788791426.883169:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322bed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322bf4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791426.883181:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322bf4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791426.883199:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788791426.883203:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788791426.883205:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788791426.883239:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994ff400/0xcd6380150a322bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791426.883247:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994ff400/0xcd6380150a322bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791426.883258:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994ff400/0xcd6380150a322bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791426.883280:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630403072:0@lo:101: 00000100:00100000:0.0:1788791426.883346:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791426.883390:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9921a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788791426.894151:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630403072 00000100:00100000:1.0:1788791426.894165:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630403072 00000100:00100000:1.0:1788791426.895714:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788791426.895731:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:5834:x1875683630403072:12345-0@lo:101: 00010000:00010000:1.0:1788791426.895766:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791426.895787:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abaa1b5c200/0xcd6380150a322c02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322bfb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791426.898104:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abaa1b5c200/0xcd6380150a322c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322bfb expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791426.898140:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abaa1b5c200/0xcd6380150a322c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322bfb expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791426.898151:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abaa1b5c200, rc 0) 00000100:00100000:1.0:1788791426.899389:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630403072:12345-0@lo:101: Request processed in 3656us (16035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791426.899401:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788791426.899636:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630403072:0@lo:101: 00010000:00010000:0.0:1788791426.899660:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994ff400/0xcd6380150a322bfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322c02 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791426.899673:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994ff400/0xcd6380150a322bfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322c02 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791426.899746:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630403200:0@lo:501: 00000100:00100000:0.0:1788791426.899789:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791426.899820:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9921a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788791426.899838:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630403200 00000100:00100000:0.0:1788791426.899844:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630403200 00000100:00100000:0.0:1788791426.899894:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788791426.899914:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630403200:12345-0@lo:501: 00000100:00100000:0.0:1788791426.900197:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630403200:12345-0@lo:501: Request processed in 284us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791426.900204:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788791426.902913:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630403200:0@lo:501: 00000100:00100000:0.0:1788791426.902969:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630403328:0@lo:503: 00000100:00100000:0.0:1788791426.903028:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791426.903064:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9921a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788791426.903082:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630403328 00000100:00100000:0.0:1788791426.903088:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630403328 00000100:00100000:0.0:1788791426.903180:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788791426.903199:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630403328:12345-0@lo:503: 00000100:00100000:0.0:1788791426.905853:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630403328:12345-0@lo:503: Request processed in 2646us (2815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791426.905868:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788791426.909609:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630403328:0@lo:503: 00000100:00100000:1.0:1788791426.912838:0:7971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc134a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:7971:1875683630403456:0@lo:502: 00000100:00100000:1.0:1788791426.912947:0:7971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791426.912991:0:7971:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791426.914528:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630403456 00000100:00100000:2.0:1788791426.914542:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630403456 00000100:00100000:2.0:1788791426.914596:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788791426.914605:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:7971:x1875683630403456:12345-0@lo:502: 00000100:00100000:2.0:1788791426.923275:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:7971:x1875683630403456:12345-0@lo:502: Request processed in 8661us (10318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791426.923290:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788791426.925305:0:7971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc134a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:7971:1875683630403456:0@lo:502: 00000020:01000000:2.0:1788791426.925358:0:7971:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788791426.925370:0:7971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791426.925372:0:7971:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788791426.925378:0:7971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788791426.925380:0:7971:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788791426.925417:0:7971:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba86258380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:7971:1875683630403584:0@lo:502: 00000100:00100000:2.0:1788791426.925697:0:7971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791426.925743:0:7971:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a3300 going to sleep for 11 seconds 00000100:00100000:3.0:1788791426.926675:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630403584 00000100:00100000:3.0:1788791426.926685:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630403584 00000100:00100000:3.0:1788791426.927031:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788791426.927042:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:7971:x1875683630403584:12345-0@lo:502: 00000100:00100000:3.0:1788791426.928036:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:7971:x1875683630403584:12345-0@lo:502: Request processed in 992us (2335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791426.928056:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788791426.928107:0:7971:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba86258380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:7971:1875683630403584:0@lo:502: 00000020:01000000:2.0:1788791426.928167:0:7971:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788791426.928174:0:7971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791426.928176:0:7971:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788791426.928180:0:7971:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788791426.928271:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788791426.928289:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788791426.928300:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994ff400/0xcd6380150a322bfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322c02 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791426.928310:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994ff400/0xcd6380150a322bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322c02 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791426.928319:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788791426.928322:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9aba98e4f000 from 30 10000000:01000000:1.0:1788791426.928331:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788791426.928363:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791426.928371:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791426.928381:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322c09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791426.928398:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc134700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630403712:0@lo:101: 00000100:00100000:1.0:1788791426.928435:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791426.928472:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788791426.928719:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630403712 00000100:00100000:2.0:1788791426.928726:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630403712 00000100:00100000:2.0:1788791426.928761:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788791426.928769:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630403712:12345-0@lo:101: 00010000:00010000:2.0:1788791426.928788:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791426.928801:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abac2171e00/0xcd6380150a322c10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322c09 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791426.928841:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abac2171e00/0xcd6380150a322c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322c09 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791426.928852:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abac2171e00/0xcd6380150a322c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322c09 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791426.928861:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abac2171e00, rc 0) 00000100:00100000:2.0:1788791426.928909:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630403712:12345-0@lo:101: Request processed in 140us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791426.928916:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788791426.928948:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc134700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630403712:0@lo:101: 00010000:00010000:2.0:1788791426.928961:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322c09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322c10 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791426.928970:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322c09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322c10 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791426.929013:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba86258380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630403840:0@lo:501: 00000100:00100000:2.0:1788791426.929038:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791426.929066:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788791426.930813:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630403840 00000100:00100000:3.0:1788791426.930835:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630403840 00000100:00100000:3.0:1788791426.930900:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788791426.930911:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630403840:12345-0@lo:501: 00000100:00100000:3.0:1788791426.931242:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630403840:12345-0@lo:501: Request processed in 329us (2199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791426.931248:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba86258380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630403840:0@lo:501: 00000100:00100000:3.0:1788791426.931262:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788791426.931295:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba86258380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630403968:0@lo:503: 00000100:00100000:2.0:1788791426.931342:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791426.931386:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788791426.933324:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630403968 00000100:00100000:3.0:1788791426.933336:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630403968 00000100:00100000:3.0:1788791426.933385:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788791426.933395:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630403968:12345-0@lo:503: 00000100:00100000:3.0:1788791426.933629:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630403968:12345-0@lo:503: Request processed in 235us (2286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791426.933636:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788791426.934386:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba86258380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630403968:0@lo:503: 00000100:00100000:1.0:1788791426.946438:0:7972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc134e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:7972:1875683630404096:0@lo:502: 00000100:00100000:1.0:1788791426.946518:0:7972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791426.946567:0:7972:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791426.946618:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630404096 00000100:00100000:3.0:1788791426.946625:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630404096 00000100:00100000:3.0:1788791426.946673:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788791426.946682:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:7972:x1875683630404096:12345-0@lo:502: 00000100:00100000:3.0:1788791426.946940:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:7972:x1875683630404096:12345-0@lo:502: Request processed in 257us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791426.946947:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788791426.947108:0:7972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc134e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:7972:1875683630404096:0@lo:502: 00000100:00100000:1.0:1788791426.947500:0:7972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc134e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:7972:1875683630404224:0@lo:502: 00000100:00100000:1.0:1788791426.947537:0:7972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791426.947565:0:7972:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791426.951400:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630404224 00000100:00100000:3.0:1788791426.951415:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630404224 00000100:00100000:3.0:1788791426.951476:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788791426.951486:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:7972:x1875683630404224:12345-0@lo:502: 00000100:00100000:3.0:1788791426.951760:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:7972:x1875683630404224:12345-0@lo:502: Request processed in 275us (4222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791426.951768:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788791426.951939:0:7972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc134e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:7972:1875683630404224:0@lo:502: 00000040:00080000:1.0:1788791426.951977:0:7972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788791426.952658:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788791426.952682:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788791426.952692:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322c09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322c10 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791426.952703:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322c10 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791426.952712:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788791426.952714:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9aba98e4f000 from 5 10000000:01000000:0.0:1788791426.952717:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788791426.952755:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791426.952763:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791426.952773:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791426.952791:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630404352:0@lo:101: 00000100:00100000:0.0:1788791426.953401:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791426.953441:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9921a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788791426.957153:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630404352 00000100:00100000:3.0:1788791426.957170:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630404352 00000100:00100000:3.0:1788791426.957329:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788791426.957340:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630404352:12345-0@lo:101: 00010000:00010000:3.0:1788791426.957358:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791426.957381:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba81525000/0xcd6380150a322c1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322c17 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791426.957412:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba81525000/0xcd6380150a322c1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322c17 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791426.957424:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba81525000/0xcd6380150a322c1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322c17 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791426.957433:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba81525000, rc 0) 00000100:00100000:3.0:1788791426.957522:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630404352:12345-0@lo:101: Request processed in 184us (4123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791426.957530:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788791426.957637:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630404352:0@lo:101: 00010000:00010000:1.0:1788791426.957657:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322c1e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791426.957667:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322c1e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791426.957738:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc134e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630404480:0@lo:256: 00000100:00100000:1.0:1788791426.957776:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791426.957904:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791426.958615:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630404480 00000100:00100000:3.0:1788791426.958626:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630404480 00000100:00100000:3.0:1788791426.960500:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788791426.960521:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630404480:12345-0@lo:256: 20000000:01000000:3.0:1788791426.960550:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788791426.960572:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788791426.960576:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788791426.960723:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630404480:12345-0@lo:256: Request processed in 211us (2945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791426.960731:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788791426.967115:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc134e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630404480:0@lo:256: 10000000:01000000:0.0:1788791426.967463:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788791426.967475:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322c1e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791426.967487:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322c1e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791426.967497:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788791426.967500:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788791426.967503:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788791426.967537:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe000/0xcd6380150a322c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791426.967546:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994fe000/0xcd6380150a322c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791426.967555:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994fe000/0xcd6380150a322c25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791426.967584:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630404608:0@lo:101: 00000100:00100000:0.0:1788791426.967646:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791426.983616:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9921aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788791426.983760:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630404608 00000100:00100000:1.0:1788791426.983771:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630404608 00000100:00100000:1.0:1788791426.983840:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788791426.983850:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630404608:12345-0@lo:101: 00010000:00010000:1.0:1788791426.983867:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791426.983897:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abaa1b5c000/0xcd6380150a322c2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322c25 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791426.983925:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abaa1b5c000/0xcd6380150a322c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322c25 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791426.983935:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abaa1b5c000/0xcd6380150a322c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322c25 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791426.983945:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abaa1b5c000, rc 0) 00000100:00100000:1.0:1788791426.984019:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630404608:12345-0@lo:101: Request processed in 169us (16371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791426.984026:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788791426.985884:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630404608:0@lo:101: 00010000:00010000:0.0:1788791426.985914:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994fe000/0xcd6380150a322c25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322c2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791426.985927:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994fe000/0xcd6380150a322c25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322c2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791426.986009:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630404736:0@lo:501: 00000100:00100000:0.0:1788791426.986065:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791426.986094:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9921aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788791426.986198:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630404736 00000100:00100000:1.0:1788791426.986205:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630404736 00000100:00100000:1.0:1788791426.986248:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788791426.986257:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630404736:12345-0@lo:501: 00000100:00100000:1.0:1788791426.986544:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630404736:12345-0@lo:501: Request processed in 287us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791426.986561:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788791426.987019:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630404736:0@lo:501: 00000100:00100000:0.0:1788791426.987052:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630404864:0@lo:503: 00000100:00100000:0.0:1788791426.987096:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791426.987121:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9921aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788791426.989611:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630404864 00000100:00100000:2.0:1788791426.989625:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630404864 00000100:00100000:2.0:1788791426.989678:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788791426.989687:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630404864:12345-0@lo:503: 00000100:00100000:2.0:1788791426.990095:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630404864:12345-0@lo:503: Request processed in 409us (2999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791426.990104:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788791426.990254:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630404864:0@lo:503: 00000100:00100000:1.0:1788791426.997623:0:7977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc135500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:7977:1875683630404992:0@lo:502: 00000100:00100000:1.0:1788791426.997718:0:7977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791426.997759:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630404992 00000100:00100000:1.0:1788791426.997766:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630404992 00000100:00100000:1.0:1788791426.997813:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788791426.997823:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:7977:x1875683630404992:12345-0@lo:502: 00000100:00100000:1.0:1788791426.998172:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:7977:x1875683630404992:12345-0@lo:502: Request processed in 349us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791426.998180:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788791426.998254:0:7977:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788791426.998735:0:7977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc135500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:7977:1875683630404992:0@lo:502: 00000020:01000000:1.0:1788791426.998771:0:7977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788791426.998778:0:7977:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788791426.998786:0:7977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791426.998788:0:7977:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788791426.998794:0:7977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788791426.998797:0:7977:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:1.0:1788791426.998819:0:7977:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788791426.998822:0:7977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788791426.998835:0:7977:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9aba88c63370) 00000020:00000080:1.0:1788791426.998859:0:7977:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788791426.998866:0:7977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788791426.998964:0:7977:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788791426.998971:0:7977:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788791426.998979:0:7977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a322c3a 00010000:00080000:1.0:1788791426.999005:0:7977:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ab981ba4800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:1.0:1788791427.006070:0:7977:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788791427.006459:0:7977:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788791427.006472:0:7977:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788791427.007001:0:7977:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788791427.007256:0:7977:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788791427.007312:0:7977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788791427.007371:0:7977:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788791427.010546:0:7979:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788791427.010553:0:7979:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788791427.012167:0:7977:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788791427.012431:0:7977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788791427.012469:0:7977:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788791427.012491:0:7977:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd6380150a322c41 00000100:00080000:3.0:1788791427.012501:0:7977:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788791427.012506:0:7977:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ab981ba4800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788791427.012539:0:7977:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9aba857b8700 x1875683630405120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788791427.012561:0:7977:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1788791427.012646:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630405120:0@lo:8: 00000100:00100000:1.0:1788791427.012709:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791427.012762:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630405120 00000100:00100000:1.0:1788791427.012768:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630405120 00000100:00100000:1.0:1788791427.012794:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788791427.012801:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875683630405120:12345-0@lo:8: 00010000:00080000:1.0:1788791427.012825:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:1.0:1788791427.012846:0:6681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd6380150a322c48 00002000:00100000:1.0:1788791427.012858:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9ab981ba5000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788791427.012862:0:6681:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788791427.012866:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788791427.012987:0:6681:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788791427.013115:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788791427.013151:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9ab981ba1800 : changing import state from RECOVER to FULL 00000020:01000000:3.0:1788791427.013422:0:7977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791427.013428:0:7977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791427.013430:0:7977:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788791427.013433:0:7977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791427.013436:0:7977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791427.013438:0:7977:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788791427.013441:0:7977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788791427.013443:0:7977:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788791427.013466:0:7977:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857bb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:7977:1875683630405248:0@lo:502: 00000100:00100000:3.0:1788791427.013515:0:7977:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791427.013538:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630405248 00000100:00100000:3.0:1788791427.013542:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630405248 00000100:00100000:3.0:1788791427.013569:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788791427.013574:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:7977:x1875683630405248:12345-0@lo:502: 00000100:00100000:3.0:1788791427.013763:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:7977:x1875683630405248:12345-0@lo:502: Request processed in 188us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791427.013770:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788791427.013809:0:7977:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788791427.013826:0:7977:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857bb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:7977:1875683630405248:0@lo:502: 00000020:01000000:3.0:1788791427.013848:0:7977:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791427.013851:0:7977:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791427.013853:0:7977:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788791427.013856:0:7977:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788791427.013925:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788791427.013945:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788791427.013954:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe000/0xcd6380150a322c25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322c2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791427.013965:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994fe000/0xcd6380150a322c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322c2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791427.013974:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788791427.013977:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9aba88c60000 from 1 10000000:01000000:3.0:1788791427.013979:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788791427.013998:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba80030200/0xcd6380150a322c4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791427.014006:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba80030200/0xcd6380150a322c4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791427.014014:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba80030200/0xcd6380150a322c4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791427.014025:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630405376:0@lo:101: 00000100:00100000:3.0:1788791427.014051:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791427.014064:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788791427.014075:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630405376 00000100:00100000:3.0:1788791427.014084:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630405376 00000100:00100000:3.0:1788791427.014103:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788791427.014108:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630405376:12345-0@lo:101: 00010000:00010000:3.0:1788791427.014115:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791427.014144:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba80030000/0xcd6380150a322c56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322c4f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791427.014163:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba80030000/0xcd6380150a322c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322c4f expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791427.014173:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba80030000/0xcd6380150a322c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322c4f expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791427.014181:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba80030000, rc 0) 00000100:00100000:3.0:1788791427.017749:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630405376:12345-0@lo:101: Request processed in 3631us (3687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791427.017763:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788791427.017852:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630405376:0@lo:101: 00010000:00010000:3.0:1788791427.017891:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba80030200/0xcd6380150a322c4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322c56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791427.017904:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba80030200/0xcd6380150a322c4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322c56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791427.017974:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630405504:0@lo:501: 00000100:00100000:3.0:1788791427.018013:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791427.018031:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788791427.018047:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630405504 00000100:00100000:3.0:1788791427.018052:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630405504 00000100:00100000:3.0:1788791427.018097:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788791427.018105:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630405504:12345-0@lo:501: 00000100:00100000:1.0:1788791427.018480:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875683630405120:12345-0@lo:8: Request processed in 5675us (5767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791427.018490:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788791427.018535:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba857b8700 x1875683630405120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788791437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791427.018545:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788791427.018552:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788791427.018567:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788791427.018572:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788791427.018575:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ab981ba4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788791427.018587:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788791427.018594:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630405120:0@lo:8: 00000004:00080000:1.0:1788791427.018616:0:7979:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788791427.018733:0:7979:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 203398604979ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788791427.020833:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630405504:12345-0@lo:501: Request processed in 2719us (2810us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788791427.020848:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788791427.020952:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630405504:0@lo:501: 10000000:01000000:3.0:1788791427.020990:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788791427.021000:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba80030200/0xcd6380150a322c4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322c56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791427.021009:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba80030200/0xcd6380150a322c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322c56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791427.023101:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630405632:0@lo:400: 00000100:00100000:0.0:1788791427.024019:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791427.024090:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630405632 00000100:00100000:0.0:1788791427.024101:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630405632 00000100:00100000:0.0:1788791427.030639:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788791427.030658:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630405632:12345-0@lo:400: 00000100:00100000:0.0:1788791427.030765:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630405632:12345-0@lo:400: Request processed in 113us (6747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791427.030773:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788791427.030833:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299c380 x1875683630405632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791427.030847:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630405632:0@lo:400: 00000100:00100000:0.0:1788791427.030921:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630405760:0@lo:400: 00000100:00100000:0.0:1788791427.030956:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791427.031016:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630405888:0@lo:400: 00000100:00100000:0.0:1788791427.031044:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791427.031075:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630405888 00000100:00100000:0.0:1788791427.031081:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630405888 00000100:00100000:0.0:1788791427.031120:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788791427.031154:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630405888:12345-0@lo:400: 00000100:00100000:2.0:1788791427.031669:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630405760 00000100:00100000:2.0:1788791427.031676:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630405760 00000100:00100000:2.0:1788791427.031711:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788791427.031718:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630405760:12345-0@lo:400: 00000100:00100000:2.0:1788791427.031760:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630405760:12345-0@lo:400: Request processed in 43us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791427.031766:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788791427.031799:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299c380 x1875683630405760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791427.031808:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630405760:0@lo:400: 00000100:00100000:0.0:1788791427.040622:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630405888:12345-0@lo:400: Request processed in 9484us (9565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791427.040637:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788791427.040680:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788791427.040686:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788791427.040751:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299d500 x1875683630405888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791427.040765:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630405888:0@lo:400: 00000100:00100000:0.0:1788791427.040934:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630406016:0@lo:400: 00000100:00100000:0.0:1788791427.040987:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791427.041025:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630406016 00000100:00100000:0.0:1788791427.041043:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630406016 00000100:00100000:0.0:1788791427.041087:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788791427.041095:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630406016:12345-0@lo:400: 00000100:00100000:0.0:1788791427.041157:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630406016:12345-0@lo:400: Request processed in 62us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791427.041163:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788791427.041176:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788791427.058520:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299d500 x1875683630406016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791427.058542:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630406016:0@lo:400: 00000004:00080000:0.0:1788791427.116771:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:02000400:2.0:1788791427.262553:0:7991:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000004:00080000:3.0:1788791427.272810:0:7980:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788791427.272840:0:7980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857bad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7980:1875683630406272:0@lo:7: 00000100:00100000:3.0:1788791427.272916:0:7980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791427.272963:0:7980:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98da6600 going to sleep for 11 seconds 00000100:00100000:3.0:1788791427.272978:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630406144:0@lo:13: 00000100:00100000:3.0:1788791427.273001:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791427.273036:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630406272 00000100:00100000:3.0:1788791427.273044:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630406272 00000100:00100000:3.0:1788791427.273089:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788791427.273096:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7980:x1875683630406272:12345-0@lo:7: 00000100:00080000:2.0:1788791427.284390:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788791427.284423:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630406144 00000100:00100000:2.0:1788791427.284432:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630406144 00000100:00100000:2.0:1788791427.284485:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788791427.284495:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875683630406144:12345-0@lo:13: 00002000:00000024:2.0:1788791427.284533:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788791427.284633:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3315:x1875683630406144:12345-0@lo:13: Request processed in 138us (11629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791427.284641:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788791427.284707:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba857bb100 x1875683630406144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791427.284728:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630406144:0@lo:13: 00002000:00080000:3.0:1788791427.287121:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788791427.287151:0:6682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788791427.289456:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7980:x1875683630406272:12345-0@lo:7: Request processed in 16350us (16531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791427.289482:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788791427.289645:0:7980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba857bad80 x1875683630406272/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788791443 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791427.289662:0:7980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857bad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7980:1875683630406272:0@lo:7: 00000004:00080000:0.0:1788791427.289676:0:7980:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788791427.289716:0:7980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7980:1875683630406400:0@lo:5: 00000100:00100000:0.0:1788791427.289752:0:7980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791427.289796:0:7980:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9921ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788791427.289814:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630406400 00000100:00100000:0.0:1788791427.289820:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630406400 00000100:00100000:0.0:1788791427.289858:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788791427.289880:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7980:x1875683630406400:12345-0@lo:5: 00002000:00080000:0.0:1788791427.289905:0:6681:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788791427.289909:0:6681:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788791427.290249:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7980:x1875683630406400:12345-0@lo:5: Request processed in 382us (495us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788791427.290256:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788791427.290422:0:7980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299d500 x1875683630406400/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788791443 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791427.290434:0:7980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7980:1875683630406400:0@lo:5: 00000004:00080000:0.0:1788791427.290443:0:7980:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788791427.290468:0:7980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7980:1875683630406528:0@lo:700: 00000100:00100000:0.0:1788791427.290493:0:7980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791427.290512:0:7980:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9921ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788791427.300959:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630406528 00000100:00100000:1.0:1788791427.300975:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630406528 00000100:00100000:1.0:1788791427.301045:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788791427.301056:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7980:x1875683630406528:12345-0@lo:700: 00000100:00100000:1.0:1788791427.301117:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6689:1875683630406656:0@lo:700: 00000100:00100000:1.0:1788791427.306513:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791427.306579:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788791427.306671:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630406656 00000100:00100000:0.0:1788791427.306679:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630406656 00000100:00100000:0.0:1788791427.306736:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788791427.306746:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6689:x1875683630406656:12345-0@lo:700: 40000000:02000000:3.0:1788791427.374384:0:5844:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1788791427.391812:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6689:x1875683630406656:12345-0@lo:700: Request processed in 85059us (85539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791427.391835:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788791427.392544:0:6689:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababc134e00 x1875683630406656/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788791443 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791427.392561:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc134e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6689:1875683630406656:0@lo:700: 40000000:02000000:2.0:1788791427.392575:0:6689:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1788791427.625767:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7980:x1875683630406528:12345-0@lo:700: Request processed in 324701us (335260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791427.625781:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:1.0:1788791427.627616:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788791427.627642:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1788791427.627707:0:7980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299ca80 x1875683630406528/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788791443 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791427.627724:0:7980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7980:1875683630406528:0@lo:700: 00010000:00010000:1.0:1788791427.751186:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:1.0:1788791427.792241:0:7980:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788791427.797810:0:7980:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc134a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7980:1875683630406784:0@lo:5: 00000100:00100000:1.0:1788791427.807160:0:7980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791427.810028:0:7980:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbccd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788791427.810056:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630406784 00000100:00100000:1.0:1788791427.810065:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630406784 00000100:00100000:1.0:1788791427.810122:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788791427.810148:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7980:x1875683630406784:12345-0@lo:5: 00002000:00080000:1.0:1788791427.828010:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788791427.828029:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788791427.861808:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7980:x1875683630406784:12345-0@lo:5: Request processed in 51652us (54647us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788791427.861822:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788791427.873069:0:7980:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababc134a80 x1875683630406784/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788791443 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791427.873088:0:7980:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788791427.873104:0:7980:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9ababc134a80 x1875683630406784/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788791443 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791427.873116:0:7980:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc134a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7980:1875683630406784:0@lo:5: 00000004:00080000:1.0:1788791427.873154:0:7980:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788791427.900451:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788791427.900474:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630406912:0@lo:13: 00000100:00100000:0.0:1788791427.900541:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791427.901083:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630406912 00000100:00100000:2.0:1788791427.901091:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630406912 00000100:00100000:2.0:1788791427.901159:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788791427.902526:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630406912:12345-0@lo:13: 00002000:00000024:2.0:1788791427.902568:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791427.902641:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630406912:12345-0@lo:13: Request processed in 1474us (2099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791427.902648:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788791427.902929:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299fb80 x1875683630406912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791427.902949:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630406912:0@lo:13: 00010000:00010000:0.0:1788791428.773043:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791429.795724:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791430.819435:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791431.847313:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791432.492319:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630407040:0@lo:400: 00000100:00100000:2.0:1788791432.492397:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791432.492452:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630407552:0@lo:400: 00000100:00100000:2.0:1788791432.492478:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791432.492503:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788791432.492509:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba86259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630407424:0@lo:400: 00000100:00100000:2.0:1788791432.492532:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791432.492577:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630407168:0@lo:400: 00000100:00100000:2.0:1788791432.492603:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791432.492621:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba86259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630407680:0@lo:400: 00000100:00100000:2.0:1788791432.492639:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791432.492655:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791432.492659:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630407296:0@lo:400: 00000100:00100000:2.0:1788791432.492680:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791432.492712:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630407552 00000100:00100000:2.0:1788791432.492719:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630407552 00000100:00100000:2.0:1788791432.492767:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630407168 00000100:00100000:2.0:1788791432.492770:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630407168 00000100:00100000:3.0:1788791432.492914:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630407040 00000100:00100000:3.0:1788791432.492919:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630407040 00000100:00100000:3.0:1788791432.493857:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788791432.493873:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630407040:12345-0@lo:400: 00000100:00100000:3.0:1788791432.493942:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630407040:12345-0@lo:400: Request processed in 75us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791432.494023:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788791432.494064:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630407424 00000100:00100000:3.0:1788791432.494070:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630407424 00000100:00100000:3.0:1788791432.494099:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630407680 00000100:00100000:3.0:1788791432.494102:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630407680 00000100:00100000:3.0:1788791432.494117:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788791432.494123:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8625bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630407424:12345-0@lo:400: 00000100:00100000:3.0:1788791432.494174:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8625bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630407424:12345-0@lo:400: Request processed in 51us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791432.494181:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788791432.494193:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788791432.494199:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8625a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875683630407680:12345-0@lo:400: 00000100:00100000:3.0:1788791432.494245:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8625a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875683630407680:12345-0@lo:400: Request processed in 46us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791432.494251:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788791432.496103:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788791432.496111:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788791432.496114:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791432.496150:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630407296 00000100:00100000:0.0:1788791432.496161:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630407296 00000100:00100000:0.0:1788791432.496210:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788791432.496219:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630407552:12345-0@lo:400: 00000100:00100000:0.0:1788791432.496292:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630407552:12345-0@lo:400: Request processed in 73us (3812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791432.496300:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788791432.496318:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788791432.496334:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630407296:12345-0@lo:400: 00000100:00100000:0.0:1788791432.496365:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630407296:12345-0@lo:400: Request processed in 32us (3684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791432.496371:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788791432.496393:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791432.497642:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788791432.497652:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630407168:12345-0@lo:400: 00000100:00100000:2.0:1788791432.497711:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630407168:12345-0@lo:400: Request processed in 60us (5106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791432.497718:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788791432.497762:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba86259c00 x1875683630407424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791432.497787:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba86259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630407424:0@lo:400: 00000100:00100000:2.0:1788791432.497802:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630407040:0@lo:400: 00010000:00080000:2.0:1788791432.497812:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba8625a680 x1875683630407552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791432.497819:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630407552:0@lo:400: 00010000:00080000:2.0:1788791432.497877:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba8625b480 x1875683630407296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791432.497903:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630407296:0@lo:400: 00010000:00080000:2.0:1788791432.497917:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba8625b100 x1875683630407168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791432.497924:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630407168:0@lo:400: 00010000:00080000:2.0:1788791432.497935:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba86259180 x1875683630407680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791432.497944:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba86259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630407680:0@lo:400: 00000100:00100000:2.0:1788791432.498066:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791432.498078:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630407808:0@lo:13: 00000100:00100000:2.0:1788791432.498112:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791432.498359:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630407808 00000100:00100000:1.0:1788791432.498366:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630407808 00000100:00100000:1.0:1788791432.498656:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788791432.498666:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875683630407808:12345-0@lo:13: 00002000:00000024:1.0:1788791432.498695:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791432.498734:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86259180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875683630407808:12345-0@lo:13: Request processed in 70us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791432.498741:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788791432.500121:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299dc00 x1875683630407808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791432.500238:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630407808:0@lo:13: 00000001:00080000:2.0:1788791432.586338:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788791432.867349:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791432.996775:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630407936:0@lo:13: 00000100:00100000:0.0:1788791432.996843:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791432.996928:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630407936 00000100:00100000:0.0:1788791432.996935:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630407936 00000100:00100000:0.0:1788791432.996976:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788791432.996983:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630407936:12345-0@lo:13: 00002000:00000024:0.0:1788791432.997016:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791432.997054:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630407936:12345-0@lo:13: Request processed in 71us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791432.997061:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788791432.997118:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299f480 x1875683630407936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791432.997155:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630407936:0@lo:13: 00000100:00100000:1.0:1788791433.818520:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791433.818693:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606265984 00000100:00100000:3.0:1788791433.818703:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606265984 00000100:00100000:3.0:1788791433.819992:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 114 00000100:00100000:3.0:1788791433.820002:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2351:x1875683606265984:12345-192.168.201.29@tcp:250: 00010000:00080000:3.0:1788791433.820032:0:5832:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from eeb43ea0-b4bb-4be2-baf9-261438e31ddf@192.168.201.29@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:3.0:1788791433.820057:0:5832:0:(genops.c:1385:class_connect()) connect: client eeb43ea0-b4bb-4be2-baf9-261438e31ddf, cookie 0xcd6380150a322c5d 00000100:00080000:3.0:1788791433.820207:0:5832:0:(import.c:65:import_set_state_nolock()) ffff9ababb5a5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788791433.820542:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+5:2351:x1875683606265984:12345-192.168.201.29@tcp:250: Request processed in 499us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791433.820549:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 114 00000100:00100000:0.0:1788791433.847706:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791433.847784:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606266112 00000100:00100000:3.0:1788791433.847794:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606266112 00000100:00100000:3.0:1788791433.847844:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:3.0:1788791433.847854:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+5:5582:x1875683606266112:12345-192.168.201.29@tcp:101: 00010000:00010000:3.0:1788791433.847870:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791433.847885:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba80030800/0xcd6380150a322c64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453674e56 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791433.847911:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba80030800/0xcd6380150a322c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e56 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791433.847922:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba80030800/0xcd6380150a322c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e56 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791433.847945:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba80030800, rc 0) 00000100:00100000:3.0:1788791433.847997:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+6:5582:x1875683606266112:12345-192.168.201.29@tcp:101: Request processed in 144us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791433.848004:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:3.0:1788791433.853744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791433.853790:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606266240 00000100:00100000:3.0:1788791433.853800:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606266240 00000100:00100000:3.0:1788791433.853839:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:3.0:1788791433.853848:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+6:5582:x1875683606266240:12345-192.168.201.29@tcp:501: 00000100:00100000:3.0:1788791433.854053:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+6:5582:x1875683606266240:12345-192.168.201.29@tcp:501: Request processed in 205us (317us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788791433.854061:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:3.0:1788791433.855236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791433.855262:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606266368 00000100:00100000:3.0:1788791433.855268:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606266368 00000100:00100000:3.0:1788791433.855295:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:3.0:1788791433.855302:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+6:5582:x1875683606266368:12345-192.168.201.29@tcp:101: 00010000:00010000:3.0:1788791433.855313:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791433.855384:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba80031a00/0xcd6380150a322c6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453674e5d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791433.855408:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba80031a00/0xcd6380150a322c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e5d expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791433.855419:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba80031a00/0xcd6380150a322c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e5d expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791433.855442:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba80031a00, rc 0) 00000100:00100000:3.0:1788791433.855472:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+7:5582:x1875683606266368:12345-192.168.201.29@tcp:101: Request processed in 170us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791433.855478:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:3.0:1788791433.858109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791433.858150:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606266496 00000100:00100000:3.0:1788791433.858158:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606266496 00000100:00100000:3.0:1788791433.858197:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:3.0:1788791433.858205:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+7:5582:x1875683606266496:12345-192.168.201.29@tcp:501: 00000100:00100000:3.0:1788791433.858901:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+8:5582:x1875683606266496:12345-192.168.201.29@tcp:501: Request processed in 693us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791433.858910:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:3.0:1788791433.860207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791433.860232:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606266624 00000100:00100000:3.0:1788791433.860239:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606266624 00000100:00100000:3.0:1788791433.860274:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00100000:3.0:1788791433.860284:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+8:5582:x1875683606266624:12345-192.168.201.29@tcp:503: 00000100:00100000:3.0:1788791433.860628:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+8:5582:x1875683606266624:12345-192.168.201.29@tcp:503: Request processed in 345us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791433.860636:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00100000:1.0:1788791433.864235:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791433.864376:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606266752 00000100:00100000:3.0:1788791433.864385:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606266752 00000100:00100000:3.0:1788791433.864427:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:3.0:1788791433.864436:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+8:5601:x1875683606266752:12345-192.168.201.29@tcp:502: 00000100:00100000:3.0:1788791433.865782:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+8:5601:x1875683606266752:12345-192.168.201.29@tcp:502: Request processed in 1342us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791433.865800:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 120 00010000:00010000:0.0:1788791433.891410:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791433.896470:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791433.897216:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606266880 00000100:00100000:0.0:1788791433.897228:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606266880 00000100:00100000:0.0:1788791433.897288:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:0.0:1788791433.897298:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+8:5601:x1875683606266880:12345-192.168.201.29@tcp:502: 00000100:00100000:0.0:1788791433.898244:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+8:5601:x1875683606266880:12345-192.168.201.29@tcp:502: Request processed in 943us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791433.898259:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:3.0:1788791433.902404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791433.902964:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606267008 00000100:00100000:1.0:1788791433.902974:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606267008 00000100:00100000:1.0:1788791433.903026:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 122 00000100:00100000:1.0:1788791433.903035:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+8:5582:x1875683606267008:12345-192.168.201.29@tcp:101: 00010000:00010000:1.0:1788791433.903051:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791433.903077:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abaa1b5d200/0xcd6380150a322c72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453674e87 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791433.903103:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abaa1b5d200/0xcd6380150a322c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e87 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791433.903114:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abaa1b5d200/0xcd6380150a322c72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e87 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791433.903123:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abaa1b5d200, rc 0) 00000100:00100000:1.0:1788791433.903195:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:5582:x1875683606267008:12345-192.168.201.29@tcp:101: Request processed in 161us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791433.903202:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 122 00000100:00100000:1.0:1788791433.909864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791433.910419:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606267136 00000100:00100000:3.0:1788791433.910431:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606267136 00000100:00100000:3.0:1788791433.910486:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:3.0:1788791433.910496:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:5582:x1875683606267136:12345-192.168.201.29@tcp:256: 20000000:01000000:3.0:1788791433.910529:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788791433.910550:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788791433.910554:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788791433.910558:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788791433.910560:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788791433.916035:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:5582:x1875683606267136:12345-192.168.201.29@tcp:256: Request processed in 5529us (6169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791433.916050:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:1.0:1788791433.920946:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791433.921052:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606267264 00000100:00100000:0.0:1788791433.921073:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606267264 00000100:00100000:0.0:1788791433.921122:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 124 00000100:00100000:0.0:1788791433.921152:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:5582:x1875683606267264:12345-192.168.201.29@tcp:101: 00010000:00010000:0.0:1788791433.921167:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791433.921183:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994fea00/0xcd6380150a322c79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453674e8e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791433.921209:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994fea00/0xcd6380150a322c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e8e expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791433.921220:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994fea00/0xcd6380150a322c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e8e expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791433.921230:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fea00, rc 0) 00000100:00100000:0.0:1788791433.921275:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:5582:x1875683606267264:12345-192.168.201.29@tcp:101: Request processed in 125us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791433.921282:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 124 00000100:00100000:1.0:1788791433.923250:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791433.924880:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606267392 00000100:00100000:3.0:1788791433.924893:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606267392 00000100:00100000:3.0:1788791433.924938:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:3.0:1788791433.924947:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:5582:x1875683606267392:12345-192.168.201.29@tcp:501: 00000100:00100000:3.0:1788791433.925691:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:5582:x1875683606267392:12345-192.168.201.29@tcp:501: Request processed in 741us (2443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791433.925700:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:1.0:1788791433.928794:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791433.928899:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606267520 00000100:00100000:2.0:1788791433.928911:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606267520 00000100:00100000:2.0:1788791433.928968:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 126 00000100:00100000:2.0:1788791433.928979:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:5582:x1875683606267520:12345-192.168.201.29@tcp:503: 00000100:00100000:2.0:1788791433.929347:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:5582:x1875683606267520:12345-192.168.201.29@tcp:503: Request processed in 369us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791433.929364:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 126 00000100:00100000:0.0:1788791433.934913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791433.934948:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606267648 00000100:00100000:0.0:1788791433.934957:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606267648 00000100:00100000:0.0:1788791433.935000:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 127 00000100:00100000:0.0:1788791433.935008:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:5604:x1875683606267648:12345-192.168.201.29@tcp:502: 00000100:00100000:0.0:1788791433.935261:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:5604:x1875683606267648:12345-192.168.201.29@tcp:502: Request processed in 253us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791433.935269:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 127 00000100:00100000:3.0:1788791433.940520:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791433.940559:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606267776 00000100:00100000:3.0:1788791433.940568:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606267776 00000100:00100000:3.0:1788791433.940610:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 128 00000100:00100000:3.0:1788791433.940619:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:5604:x1875683606267776:12345-192.168.201.29@tcp:502: 00000100:00100000:3.0:1788791433.940839:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:5604:x1875683606267776:12345-192.168.201.29@tcp:502: Request processed in 219us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791433.940855:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 128 00000100:00100000:3.0:1788791433.946951:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791433.947183:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606267904 00000100:00100000:2.0:1788791433.947191:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606267904 00000100:00100000:2.0:1788791433.947233:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:2.0:1788791433.947241:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2351:x1875683606267904:12345-192.168.201.29@tcp:38: 00010000:00080000:2.0:1788791433.947267:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:2.0:1788791433.947308:0:5837:0:(genops.c:1385:class_connect()) connect: client aafa64f5-7c0a-45ff-aeda-f3a6deb3b804, cookie 0xcd6380150a322c80 00000004:00100000:2.0:1788791433.947633:0:5837:0:(mdt_handler.c:7331:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788791433.947640:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788791433.983665:0:5837:0:(import.c:65:import_set_state_nolock()) ffff9abab306b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788791433.983757:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2351:x1875683606267904:12345-192.168.201.29@tcp:38: Request processed in 36506us (36805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791433.983769:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00010000:00010000:0.0:1788791434.916725:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791434.988414:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791434.988453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791434.988547:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606268032 00000100:00100000:1.0:1788791434.988557:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606268032 00000100:00100000:1.0:1788791434.988638:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606268160 00000100:00100000:1.0:1788791434.988642:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606268160 00000100:00100000:1.0:1788791434.988659:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:1.0:1788791434.988682:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:0:x1875683606268032:12345-192.168.201.29@tcp:41: 00000004:00000024:1.0:1788791434.988726:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788791434.988800:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:0:x1875683606268032:12345-192.168.201.29@tcp:41: Request processed in 119us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791434.988808:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:1.0:1788791434.988825:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:1.0:1788791434.988831:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:5582:x1875683606268160:12345-192.168.201.29@tcp:41: 00000004:00000024:1.0:1788791434.988841:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788791434.988858:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:5582:x1875683606268160:12345-192.168.201.29@tcp:41: Request processed in 27us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791434.988864:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00080000:0.0:1788791434.989171:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791434.994200:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791434.994348:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606268288 00000100:00100000:1.0:1788791434.994359:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606268288 00000100:00100000:1.0:1788791434.994434:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1788791434.994446:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:5582:x1875683606268288:12345-192.168.201.29@tcp:40: 00000100:00100000:1.0:1788791434.994550:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:5582:x1875683606268288:12345-192.168.201.29@tcp:40: Request processed in 106us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791434.994557:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1788791435.004213:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791435.006386:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606268416 00000100:00100000:3.0:1788791435.006411:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606268416 00000100:00100000:3.0:1788791435.006467:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1788791435.006476:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875683606268416:12345-192.168.201.29@tcp:8: 00010000:00080000:3.0:1788791435.006508:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:3.0:1788791435.006548:0:6683:0:(genops.c:1385:class_connect()) connect: client aafa64f5-7c0a-45ff-aeda-f3a6deb3b804, cookie 0xcd6380150a322c87 00002000:00100000:3.0:1788791435.006561:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aafa64f5-7c0a-45ff-aeda-f3a6deb3b804/ffff9ababb5a6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788791435.006584:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788791435.006937:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788791435.006971:0:6683:0:(import.c:65:import_set_state_nolock()) ffff9ababb5a4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788791435.009664:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc137100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2351:x1875683606268416:12345-192.168.201.29@tcp:8: Request processed in 3174us (5448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791435.009679:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:1.0:1788791435.010241:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791435.010678:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606268672 00000100:00100000:2.0:1788791435.010687:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606268672 00000100:00100000:2.0:1788791435.010740:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 129 00000100:00100000:2.0:1788791435.010750:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2355:x1875683606268672:12345-192.168.201.29@tcp:400: 00000100:00100000:2.0:1788791435.010805:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2355:x1875683606268672:12345-192.168.201.29@tcp:400: Request processed in 57us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791435.010812:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 129 00000100:00100000:1.0:1788791435.011229:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791435.011283:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791435.011320:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606268800 00000100:00100000:1.0:1788791435.011324:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606268800 00000100:00100000:1.0:1788791435.011351:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:1.0:1788791435.011358:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:5582:x1875683606268800:12345-192.168.201.29@tcp:33: 00000100:00100000:2.0:1788791435.011520:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606268544 00000100:00100000:2.0:1788791435.011524:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606268544 00000100:00100000:2.0:1788791435.011547:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:2.0:1788791435.011552:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1875683606268544:12345-192.168.201.29@tcp:8: 00010000:00080000:2.0:1788791435.011576:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:2.0:1788791435.011618:0:6681:0:(genops.c:1385:class_connect()) connect: client aafa64f5-7c0a-45ff-aeda-f3a6deb3b804, cookie 0xcd6380150a322c8e 00002000:00100000:2.0:1788791435.011630:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aafa64f5-7c0a-45ff-aeda-f3a6deb3b804/ffff9abab306a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788791435.011654:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788791435.011977:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788791435.012005:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9abab306f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788791435.012314:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc134380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2351:x1875683606268544:12345-192.168.201.29@tcp:8: Request processed in 750us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791435.012323:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000004:00080000:2.0:1788791435.057848:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 45384us 00000004:00200000:3.0:1788791435.070023:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1788791435.070581:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:5582:x1875683606268800:12345-192.168.201.29@tcp:33: Request processed in 59215us (59290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791435.070597:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1788791435.269163:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791435.269356:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606268928 00000100:00100000:2.0:1788791435.269366:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606268928 00000100:00100000:2.0:1788791435.269434:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1788791435.269446:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:5621:x1875683606268928:12345-192.168.201.29@tcp:101: 00010000:00010000:2.0:1788791435.269467:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791435.269521:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170200/0xcd6380150a322c95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674eb8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791435.269591:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170600/0xcd6380150a322c9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791435.269758:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170600/0xcd6380150a322c9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791435.269777:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170600/0xcd6380150a322c9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791435.269982:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1788791435.269986:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788791435.270223:0:5837:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170600/0xcd6380150a322c9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791435.270249:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170200/0xcd6380150a322c95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674eb8 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791435.270266:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170600/0xcd6380150a322c9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674eb8 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791435.270275:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba8533f900) 00010000:00010000:2.0:1788791435.270278:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788791435.270707:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abac2170600, rc 0) 00000100:00100000:2.0:1788791435.270792:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:5621:x1875683606268928:12345-192.168.201.29@tcp:101: Request processed in 1347us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791435.270800:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00010000:00010000:0.0:1788791435.943080:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791436.963628:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791437.603387:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630408064:0@lo:400: 00000100:00100000:2.0:1788791437.603478:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791437.603584:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630408192:0@lo:13: 00000100:00100000:0.0:1788791437.603618:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791437.603660:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630408192 00000100:00100000:0.0:1788791437.603668:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630408192 00000100:00100000:0.0:1788791437.603732:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788791437.603743:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630408192:12345-0@lo:13: 00002000:00000024:0.0:1788791437.603777:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791437.603864:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630408064 00000100:00100000:3.0:1788791437.603869:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630408064 00000100:00100000:3.0:1788791437.603908:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788791437.603915:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630408064:12345-0@lo:400: 00000100:00080000:0.0:1788791437.603947:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788791437.603995:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630408192:12345-0@lo:13: Request processed in 253us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791437.604002:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788791437.604109:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299f480 x1875683630408192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791453 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791437.604121:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788791437.604227:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630408192:0@lo:13: 00000100:00100000:0.0:1788791437.604241:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788791437.604247:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630408320:0@lo:400: 00000100:00100000:0.0:1788791437.604931:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791437.604973:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630408448:0@lo:400: 00000100:00100000:0.0:1788791437.604997:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791437.605546:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630408320 00000100:00100000:0.0:1788791437.605553:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630408320 00000100:00100000:0.0:1788791437.605588:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630408448 00000100:00100000:0.0:1788791437.605599:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630408448 00000100:00100000:0.0:1788791437.605621:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788791437.605628:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630408320:12345-0@lo:400: 00000100:00100000:0.0:1788791437.605674:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630408320:12345-0@lo:400: Request processed in 47us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791437.605681:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788791437.605707:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788791437.605713:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630408448:12345-0@lo:400: 00000100:00100000:0.0:1788791437.605739:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630408448:12345-0@lo:400: Request processed in 27us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791437.605745:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788791437.605763:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791437.605790:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630408448:0@lo:400: 00000100:00100000:0.0:1788791437.605811:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630408320:0@lo:400: 00000100:00100000:3.0:1788791437.607571:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630408064:12345-0@lo:400: Request processed in 3647us (4085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791437.607585:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788791437.607806:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788791437.607819:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630408576:0@lo:400: 00000100:00100000:3.0:1788791437.608267:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788791437.608279:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630408704:0@lo:400: 00000100:00100000:3.0:1788791437.608339:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791437.608381:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630408704 00000100:00100000:3.0:1788791437.608388:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630408704 00000100:00100000:3.0:1788791437.608450:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788791437.608459:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630408704:12345-0@lo:400: 00000100:00100000:3.0:1788791437.608505:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb785880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630408704:12345-0@lo:400: Request processed in 48us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791437.608511:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788791437.608545:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630408704:0@lo:400: 00000100:00080000:3.0:1788791437.608562:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791437.608950:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791437.610549:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630408576 00000100:00100000:3.0:1788791437.610561:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630408576 00000100:00100000:3.0:1788791437.610608:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788791437.610617:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630408576:12345-0@lo:400: 00000100:00100000:3.0:1788791437.610681:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630408576:12345-0@lo:400: Request processed in 65us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791437.610699:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788791437.610977:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788791437.611553:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababc135c00 x1875683630408576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791437.611583:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630408576:0@lo:400: 00000100:00100000:2.0:1788791437.612547:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630408064:0@lo:400: 00000001:00100000:2.0:1788791437.680269:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00000100:00100000:3.0:1788791437.785715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791437.785927:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606269056 00000100:00100000:2.0:1788791437.785938:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606269056 00000100:00100000:2.0:1788791437.786024:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:2.0:1788791437.786035:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:5673:x1875683606269056:12345-192.168.201.29@tcp:41: 00000004:00000024:2.0:1788791437.786084:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788791437.786181:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb785500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:5673:x1875683606269056:12345-192.168.201.29@tcp:41: Request processed in 147us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791437.786188:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00080000:3.0:1788791437.787636:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791437.790494:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791437.790674:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606269184 00000100:00100000:0.0:1788791437.790692:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606269184 00000100:00100000:0.0:1788791437.790763:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:0.0:1788791437.790773:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:5673:x1875683606269184:12345-192.168.201.29@tcp:13: 00002000:00000024:0.0:1788791437.790809:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791437.790874:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:5673:x1875683606269184:12345-192.168.201.29@tcp:13: Request processed in 102us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791437.790881:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00080000:3.0:1788791437.791097:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788791437.793009:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791437.793095:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606269312 00000100:00100000:0.0:1788791437.793103:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606269312 00000100:00100000:0.0:1788791437.793191:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:0.0:1788791437.793202:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:5673:x1875683606269312:12345-192.168.201.29@tcp:13: 00002000:00000024:0.0:1788791437.793240:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791437.793310:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:5673:x1875683606269312:12345-192.168.201.29@tcp:13: Request processed in 109us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791437.793318:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00080000:3.0:1788791437.793620:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788791437.989520:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791438.116348:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791438.116375:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630408832:0@lo:13: 00000100:00100000:1.0:1788791438.116448:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791438.116684:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630408832 00000100:00100000:2.0:1788791438.116695:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630408832 00000100:00100000:2.0:1788791438.116749:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788791438.116758:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630408832:12345-0@lo:13: 00002000:00000024:2.0:1788791438.116782:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791438.116838:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc135c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630408832:12345-0@lo:13: Request processed in 81us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791438.116845:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788791438.116955:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299fb80 x1875683630408832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791438.116973:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630408832:0@lo:13: 00010000:00010000:1.0:1788791439.020709:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788791439.230843:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00000001:00100000:3.0:1788791439.744533:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00010000:00010000:1.0:1788791440.049363:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791440.432380:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791440.432422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791440.432455:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791440.432481:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791440.432508:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606269440 00000100:00100000:3.0:1788791440.432518:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606269440 00000100:00100000:3.0:1788791440.432564:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00100000:3.0:1788791440.432574:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2353:x1875683606269440:12345-192.168.201.29@tcp:400: 00000100:00100000:3.0:1788791440.432654:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2353:x1875683606269440:12345-192.168.201.29@tcp:400: Request processed in 81us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791440.432662:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00100000:3.0:1788791440.432694:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606269824 00000100:00100000:3.0:1788791440.432698:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606269824 00000100:00100000:3.0:1788791440.432730:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606269696 00000100:00100000:3.0:1788791440.432733:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606269696 00000100:00100000:3.0:1788791440.432761:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1788791440.432770:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2353:x1875683606269824:12345-192.168.201.29@tcp:400: 00000100:00100000:3.0:1788791440.432806:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb787800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2353:x1875683606269824:12345-192.168.201.29@tcp:400: Request processed in 39us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791440.432814:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1788791440.432826:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1788791440.432833:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2353:x1875683606269696:12345-192.168.201.29@tcp:400: 00000100:00100000:3.0:1788791440.432857:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb784700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2353:x1875683606269696:12345-192.168.201.29@tcp:400: Request processed in 24us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791440.432862:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00080000:3.0:1788791440.432880:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788791440.432884:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788791440.433884:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606269568 00000100:00100000:1.0:1788791440.433893:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606269568 00000100:00100000:1.0:1788791440.433952:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:1.0:1788791440.433962:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2353:x1875683606269568:12345-192.168.201.29@tcp:400: 00000100:00100000:1.0:1788791440.434009:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb784e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2353:x1875683606269568:12345-192.168.201.29@tcp:400: Request processed in 49us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791440.434016:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00080000:3.0:1788791440.434392:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788791440.881476:0:8298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788791441.060888:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791442.084399:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791442.723259:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630408960:0@lo:13: 00000100:00100000:0.0:1788791442.723326:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791442.723393:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630408960 00000100:00100000:0.0:1788791442.723401:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630408960 00000100:00100000:0.0:1788791442.723452:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788791442.723460:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630408960:12345-0@lo:13: 00002000:00000024:0.0:1788791442.723493:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791442.723555:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630408960:12345-0@lo:13: Request processed in 94us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791442.723561:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788791442.723592:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788791442.723700:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299d500 x1875683630408960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791458 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791442.723718:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630408960:0@lo:13: 00000100:00100000:3.0:1788791442.727723:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630409088:0@lo:400: 00000100:00100000:3.0:1788791442.727791:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791442.728044:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630409088 00000100:00100000:0.0:1788791442.728051:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630409088 00000100:00100000:0.0:1788791442.728094:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788791442.728102:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630409088:12345-0@lo:400: 00000100:00100000:2.0:1788791442.728878:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630409216:0@lo:400: 00000100:00100000:2.0:1788791442.728913:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791442.728944:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791442.728951:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630409344:0@lo:400: 00000100:00100000:2.0:1788791442.728973:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791442.728982:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630409088:12345-0@lo:400: Request processed in 880us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791442.728991:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788791442.729001:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630409216 00000100:00100000:2.0:1788791442.729005:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630409216 00000100:00100000:2.0:1788791442.729030:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630409344 00000100:00100000:2.0:1788791442.729033:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630409344 00000100:00100000:0.0:1788791442.729036:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788791442.729043:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630409216:12345-0@lo:400: 00000100:00100000:2.0:1788791442.729056:0:5839:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788791442.729062:0:5839:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788791442.729087:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630409216:12345-0@lo:400: Request processed in 44us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791442.729093:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788791442.729107:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788791442.729113:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630409344:12345-0@lo:400: 00000100:00100000:0.0:1788791442.729156:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630409344:12345-0@lo:400: Request processed in 43us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791442.729161:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788791442.729209:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630409344:0@lo:400: 00000100:00100000:2.0:1788791442.729220:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630409216:0@lo:400: 00000100:00080000:2.0:1788791442.729380:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791442.729393:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630409472:0@lo:400: 00000100:00100000:2.0:1788791442.729420:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791442.729437:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788791442.729441:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba86259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630409600:0@lo:400: 00000100:00100000:2.0:1788791442.729457:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791442.729868:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630409600 00000100:00100000:2.0:1788791442.729873:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630409600 00000100:00100000:2.0:1788791442.729906:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788791442.729913:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8625a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630409600:12345-0@lo:400: 00000100:00100000:2.0:1788791442.729952:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8625a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630409600:12345-0@lo:400: Request processed in 40us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791442.729958:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788791442.729972:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791442.729990:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba86259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630409600:0@lo:400: 00000100:00100000:0.0:1788791442.730008:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630409472 00000100:00100000:0.0:1788791442.730011:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630409472 00000100:00100000:0.0:1788791442.730044:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788791442.730050:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8625b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630409472:12345-0@lo:400: 00000100:00100000:0.0:1788791442.730092:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8625b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630409472:12345-0@lo:400: Request processed in 42us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791442.730098:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788791442.730113:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788791442.730149:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba8625ad80 x1875683630409472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791442.730161:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630409472:0@lo:400: 00000100:00100000:3.0:1788791442.730400:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630409088:0@lo:400: 00010000:00010000:1.0:1788791443.110812:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791443.235392:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788791443.235422:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630409728:0@lo:13: 00000100:00100000:0.0:1788791443.235497:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791443.235558:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630409728 00000100:00100000:0.0:1788791443.235565:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630409728 00000100:00100000:0.0:1788791443.235631:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788791443.235644:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630409728:12345-0@lo:13: 00002000:00000024:0.0:1788791443.235695:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791443.235746:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630409728:12345-0@lo:13: Request processed in 106us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791443.235754:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788791443.235799:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299d500 x1875683630409728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791443.235817:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630409728:0@lo:13: 00010000:00010000:1.0:1788791444.131449:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788791444.663043:0:8446:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd51880260 20000000:00000080:0.0:1788791444.663065:0:8446:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9abab3e28000 uarg=0000000000000000 20000000:01000000:0.0:1788791444.663108:0:8446:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788791444.663111:0:8446:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788791444.663114:0:8446:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788791444.663119:0:8446:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788791444.663374:0:8446:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788791444.663392:0:8446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788791444.663395:0:8446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788791444.663601:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788791444.663604:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788791444.664575:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1788791444.665076:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1788791444.665539:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1788791444.665598:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1788791444.665612:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788791444.665615:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788791444.668065:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788791444.668723:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788791444.668764:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788791444.668891:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1788791444.668907:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788791444.668909:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788791444.669713:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788791444.670405:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788791444.670471:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788791444.670519:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1788791444.670534:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788791444.670536:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788791444.672642:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1788791444.673444:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1788791444.673522:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1788791444.673573:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1788791444.673595:0:8446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788791444.673615:0:8446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ca3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.673642:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba81524e00/0xcd6380150a322ba0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322b99 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.673649:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322bca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322bc3 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.673656:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9abaa1b5d800/0xcd6380150a322bf4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322bed expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.673663:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9abaa1b5c200/0xcd6380150a322c02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322bfb expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.673671:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9abac2171e00/0xcd6380150a322c10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322c09 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.673678:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9abaa1b5c000/0xcd6380150a322c2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322c25 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.673685:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba80030000/0xcd6380150a322c56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322c4f expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.673695:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba80030800/0xcd6380150a322c64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e56 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.673702:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba80031a00/0xcd6380150a322c6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e5d expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.673709:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ca3 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.673763:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba80031a00/0xcd6380150a322c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e5d expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.673780:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9aba80031a00/0xcd6380150a322c6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e5d expref: 9 pid: 5832 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791444.673796:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630409856:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788791444.674004:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba80030800/0xcd6380150a322c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e56 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.674013:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9aba80030800/0xcd6380150a322c64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e56 expref: 9 pid: 5831 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791444.674022:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc144700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630409984:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788791444.674053:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba80030000/0xcd6380150a322c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322c4f expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.674061:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9aba80030000/0xcd6380150a322c56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322c4f expref: 18 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791444.674070:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc144e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630410112:0@lo:104: 00000100:00100000:0.0:1788791444.674120:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788791444.674191:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9abaa1b5c000/0xcd6380150a322c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322c25 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.674199:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9abaa1b5c000/0xcd6380150a322c2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322c25 expref: 18 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791444.674216:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb702300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630410240:0@lo:104: 00000100:00100000:0.0:1788791444.674241:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788791444.674439:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9abac2171e00/0xcd6380150a322c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322c09 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.674447:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9abac2171e00/0xcd6380150a322c10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322c09 expref: 18 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791444.674455:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb702a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630410368:0@lo:104: 00010000:00010000:0.0:1788791444.674482:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9abaa1b5c200/0xcd6380150a322c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322bfb expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.674489:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9abaa1b5c200/0xcd6380150a322c02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322bfb expref: 18 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791444.674496:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb701880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630410496:0@lo:104: 00010000:00010000:0.0:1788791444.674518:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9abaa1b5d800/0xcd6380150a322bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322bed expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.674525:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9abaa1b5d800/0xcd6380150a322bf4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322bed expref: 18 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791444.674532:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb701500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630410624:0@lo:104: 00010000:00010000:0.0:1788791444.674554:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322bc3 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.674573:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322bca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322bc3 expref: 18 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791444.674592:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb700e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630410752:0@lo:104: 00010000:00010000:0.0:1788791444.674618:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba81524e00/0xcd6380150a322ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322b99 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.674626:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9aba81524e00/0xcd6380150a322ba0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322b99 expref: 18 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791444.674634:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb703800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630410880:0@lo:104: 00000100:00100000:0.0:1788791444.674651:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916c5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791444.675192:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/3 left), rc = 0 00000100:00100000:3.0:1788791444.675215:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791444.675231:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791444.675240:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791444.675250:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791444.675335:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791444.675353:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630410112 00000100:00100000:3.0:1788791444.675366:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630410112 00000100:00100000:3.0:1788791444.675407:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630410240 00000100:00100000:3.0:1788791444.675411:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630410240 00000100:00100000:3.0:1788791444.675423:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630410368 00000100:00100000:3.0:1788791444.675425:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630410368 00000100:00100000:3.0:1788791444.675434:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630410496 00000100:00100000:3.0:1788791444.675437:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630410496 00000100:00100000:3.0:1788791444.675445:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630410624 00000100:00100000:3.0:1788791444.675447:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630410624 00000100:00100000:3.0:1788791444.675455:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630410752 00000100:00100000:3.0:1788791444.675458:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630410752 00000100:00100000:3.0:1788791444.675467:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630410880 00000100:00100000:3.0:1788791444.675469:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630410880 00000100:00100000:3.0:1788791444.675482:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788791444.675491:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb700000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+9:8446:x1875683630410112:12345-0@lo:104: 00010000:00010000:3.0:1788791444.675505:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba80030200/0xcd6380150a322c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322c56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791444.675652:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788791444.675659:0:5820:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788791444.675666:0:5820:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1788791444.675889:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788791444.675898:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+9:8446:x1875683630410240:12345-0@lo:104: 00010000:00010000:2.0:1788791444.675907:0:8451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba994fe000/0xcd6380150a322c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322c2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.675956:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788791444.675964:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb700000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+9:8446:x1875683630410112:12345-0@lo:104: Request processed in 474us (1843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791444.675970:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788791444.675988:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788791444.675995:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb784a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+8:8446:x1875683630410368:12345-0@lo:104: 00010000:00010000:3.0:1788791444.676003:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322c10 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791444.676196:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc144e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630410112:0@lo:104: 00000100:00100000:0.0:1788791444.676206:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb702300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630410240:0@lo:104: 00000100:00100000:0.0:1788791444.676213:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb702a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630410368:0@lo:104: 00010000:00010000:1.0:1788791444.676336:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788791444.676345:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba80030200/0xcd6380150a322c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322c56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.676353:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba80030200 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791444.676357:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba80030200/0xcd6380150a322c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322c56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.676366:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba80030200/0xcd6380150a322c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322c56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791444.676374:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba80030200/0xcd6380150a322c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322c56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791444.676381:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788791444.676472:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba80030200/0xcd6380150a322c4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322c56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.676479:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791444.676502:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba80030200/0xcd6380150a322c4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322c56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.676510:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba80030200/0xcd6380150a322c4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322c56 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.676523:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788791444.676527:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba994fe000/0xcd6380150a322c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322c2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.676546:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe000 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791444.676549:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fe000/0xcd6380150a322c25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322c2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.676556:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba994fe000/0xcd6380150a322c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322c2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791444.676575:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fe000/0xcd6380150a322c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322c2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791444.676581:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788791444.676621:0:8451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788791444.676627:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+8:8446:x1875683630410240:12345-0@lo:104: Request processed in 731us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791444.676636:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788791444.676672:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788791444.676680:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb784380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+7:8446:x1875683630410496:12345-0@lo:104: 00010000:00010000:2.0:1788791444.676687:0:8451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba994ff400/0xcd6380150a322bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322c02 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791444.676727:0:8451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788791444.676738:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb784380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+7:8446:x1875683630410496:12345-0@lo:104: Request processed in 60us (1506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791444.676744:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788791444.676757:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788791444.676764:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb786d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+6:8446:x1875683630410624:12345-0@lo:104: 00010000:00010000:2.0:1788791444.676771:0:8451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322bf4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791444.676800:0:8451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788791444.676820:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb786d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+6:8446:x1875683630410624:12345-0@lo:104: Request processed in 57us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791444.676826:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788791444.676838:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788791444.676844:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb787100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+5:8446:x1875683630410752:12345-0@lo:104: 00010000:00010000:2.0:1788791444.676850:0:8451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322bc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322bca expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791444.676876:0:8451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788791444.676881:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb787100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+5:8446:x1875683630410752:12345-0@lo:104: Request processed in 38us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791444.676886:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788791444.676908:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788791444.676914:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb787480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+4:8446:x1875683630410880:12345-0@lo:104: 00010000:00010000:2.0:1788791444.676921:0:8451:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322b99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322ba0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791444.676946:0:8451:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788791444.676956:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb787480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+4:8446:x1875683630410880:12345-0@lo:104: Request processed in 43us (1697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791444.676963:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788791444.677119:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb701880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630410496:0@lo:104: 00000100:00100000:0.0:1788791444.677168:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb701500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630410624:0@lo:104: 00000100:00100000:0.0:1788791444.677174:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb700e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630410752:0@lo:104: 00000100:00100000:0.0:1788791444.677182:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb703800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630410880:0@lo:104: 00000100:00100000:2.0:1788791444.677596:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791444.677611:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630411008:0@lo:103: 00000100:00100000:2.0:1788791444.677657:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791444.677740:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630411008 00000100:00100000:0.0:1788791444.677748:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630411008 00010000:00010000:0.0:1788791444.677773:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba80030000/0xcd6380150a322c56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322c4f expref: 19 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791444.677818:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788791444.677826:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86258a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630411008:12345-0@lo:103: 00010000:00010000:0.0:1788791444.677838:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791444.677845:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba80030000/0xcd6380150a322c56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322c4f expref: 19 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.677863:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba80030000/0xcd6380150a322c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322c4f expref: 19 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.677880:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba80030000/0xcd6380150a322c56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322c4f expref: 19 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.677895:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791444.677927:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86258a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:3314:x1875683630411008:12345-0@lo:103: Request processed in 101us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791444.677933:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788791444.677959:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630411008:0@lo:103: 00010000:00010000:1.0:1788791444.678194:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba994fe000/0xcd6380150a322c25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322c2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.678201:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788791444.678243:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630411136:0@lo:103: 00000100:00100000:2.0:1788791444.678280:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788791444.678423:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba994fe000/0xcd6380150a322c25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322c2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.678431:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba994fe000/0xcd6380150a322c25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322c2c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.678444:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788791444.678448:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322c10 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.678454:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abaa1b5ca00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791444.678458:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322c10 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.678476:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322c10 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791444.678482:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322c10 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791444.678488:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788791444.678522:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322c09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322c10 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.678528:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788791444.678703:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788791444.678712:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb784a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:8446:x1875683630410368:12345-0@lo:104: Request processed in 2717us (3495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791444.678719:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788791444.678787:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630411264:0@lo:103: 00000100:00100000:0.0:1788791444.678828:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791444.678864:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630411136 00000100:00100000:0.0:1788791444.678868:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630411136 00010000:00010000:0.0:1788791444.678886:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9abaa1b5c000/0xcd6380150a322c2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322c25 expref: 18 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791444.678912:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630411264 00000100:00100000:0.0:1788791444.678915:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630411264 00010000:00010000:0.0:1788791444.678927:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9abac2171e00/0xcd6380150a322c10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322c09 expref: 19 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791444.678940:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788791444.678946:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86259c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3312:x1875683630411136:12345-0@lo:103: 00010000:00010000:0.0:1788791444.678953:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791444.678958:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9abaa1b5c000/0xcd6380150a322c2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322c25 expref: 19 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.678971:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9abaa1b5c000/0xcd6380150a322c2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322c25 expref: 19 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.678982:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abaa1b5c000/0xcd6380150a322c2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322c25 expref: 19 pid: 5830 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.678991:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791444.679073:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788791444.679081:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788791444.679200:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788791444.679208:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb700700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:3313:x1875683630411264:12345-0@lo:103: 00010000:00010000:3.0:1788791444.679216:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791444.679220:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9abac2171e00/0xcd6380150a322c10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322c09 expref: 18 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.679228:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9abac2171e00/0xcd6380150a322c10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322c09 expref: 18 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.679239:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abac2171e00/0xcd6380150a322c10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322c09 expref: 18 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.679248:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791444.679291:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb700700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:3313:x1875683630411264:12345-0@lo:103: Request processed in 85us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791444.679297:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788791444.679596:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322c09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322c10 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.679604:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322c09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322c10 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.679616:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788791444.679620:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba994ff400/0xcd6380150a322bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322c02 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.679626:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff400 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791444.679629:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba994ff400/0xcd6380150a322bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322c02 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.679637:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba994ff400/0xcd6380150a322bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322c02 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791444.679644:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba994ff400/0xcd6380150a322bfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322c02 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791444.679655:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788791444.679672:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba994ff400/0xcd6380150a322bfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322c02 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.679678:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791444.679698:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba994ff400/0xcd6380150a322bfb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322c02 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.679705:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba994ff400/0xcd6380150a322bfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322c02 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.679714:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788791444.679717:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322bf4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.679722:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81524600 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791444.679724:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322bf4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.679731:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322bf4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791444.679737:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322bf4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791444.679742:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788791444.679751:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322bed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322bf4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.679756:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791444.679765:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322bed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322bf4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.679771:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba81524600/0xcd6380150a322bed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322bf4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.679779:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788791444.679782:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322bc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322bca expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.679787:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe600 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791444.679790:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322bc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322bca expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.679797:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322bca expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791444.679888:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630411392:0@lo:103: 00000100:00100000:3.0:1788791444.679916:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791444.679934:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788791444.679939:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630411520:0@lo:103: 00000100:00100000:3.0:1788791444.679954:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791444.679970:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630411392 00000100:00100000:3.0:1788791444.679973:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630411392 00010000:00010000:3.0:1788791444.679987:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9abaa1b5c200/0xcd6380150a322c02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322bfb expref: 17 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791444.679999:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630411520 00000100:00100000:3.0:1788791444.680001:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630411520 00010000:00010000:3.0:1788791444.680015:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9abaa1b5d800/0xcd6380150a322bf4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322bed expref: 18 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791444.680026:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788791444.680031:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb785c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:3314:x1875683630411392:12345-0@lo:103: 00010000:00010000:3.0:1788791444.680038:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791444.680042:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9abaa1b5c200/0xcd6380150a322c02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322bfb expref: 18 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.680050:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9abaa1b5c200/0xcd6380150a322c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322bfb expref: 18 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.680061:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abaa1b5c200/0xcd6380150a322c02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322bfb expref: 18 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.680069:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791444.680092:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb785c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:3314:x1875683630411392:12345-0@lo:103: Request processed in 60us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791444.680098:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788791444.680109:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788791444.680114:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb786680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:3314:x1875683630411520:12345-0@lo:103: 00010000:00010000:3.0:1788791444.680120:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791444.680124:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9abaa1b5d800/0xcd6380150a322bf4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322bed expref: 16 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.680148:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9abaa1b5d800/0xcd6380150a322bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322bed expref: 16 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.680157:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abaa1b5d800/0xcd6380150a322bf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322bed expref: 16 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.680175:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791444.680193:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb786680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:3314:x1875683630411520:12345-0@lo:103: Request processed in 79us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791444.680199:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788791444.680223:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630411520:0@lo:103: 00000100:00100000:3.0:1788791444.680230:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630411392:0@lo:103: 10000000:00010000:1.0:1788791444.680328:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322bca expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791444.680335:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788791444.680349:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322bc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322bca expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.680355:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791444.680361:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322bc3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322bca expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.680367:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a322bc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322bca expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.680377:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791444.680384:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322b99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322ba0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.680390:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abac2171400 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791444.680393:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322b99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322ba0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.680400:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322ba0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791444.680407:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322ba0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791444.680412:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788791444.680420:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322b99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322ba0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.680425:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791444.680429:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322b99 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322ba0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.680435:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322b99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322ba0 expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.680445:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791444.680446:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791444.680448:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791444.680459:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791444.680523:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86259c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:3312:x1875683630411136:12345-0@lo:103: Request processed in 1577us (2242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791444.680530:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788791444.680549:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630411776:0@lo:103: 00000100:00100000:0.0:1788791444.680582:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791444.680617:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630411264:0@lo:103: 00000100:00100000:0.0:1788791444.680626:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788791444.680631:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630411648:0@lo:103: 00000100:00100000:0.0:1788791444.680649:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791444.680703:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630411776 00000100:00100000:1.0:1788791444.680707:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630411776 00010000:00010000:1.0:1788791444.680722:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba81524e00/0xcd6380150a322ba0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322b99 expref: 14 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791444.680754:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630411648 00000100:00100000:1.0:1788791444.680757:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630411648 00010000:00010000:1.0:1788791444.680767:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322bca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322bc3 expref: 15 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791444.680777:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788791444.680782:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb700a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:3313:x1875683630411776:12345-0@lo:103: 00010000:00010000:1.0:1788791444.680789:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791444.680793:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba81524e00/0xcd6380150a322ba0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322b99 expref: 15 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.680801:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba81524e00/0xcd6380150a322ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322b99 expref: 15 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.680892:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba81524e00/0xcd6380150a322ba0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322b99 expref: 15 pid: 5831 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.680902:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791444.680927:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb700a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:3313:x1875683630411776:12345-0@lo:103: Request processed in 144us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791444.680933:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788791444.680945:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788791444.680950:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa001f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:3313:x1875683630411648:12345-0@lo:103: 00010000:00010000:1.0:1788791444.680957:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791444.680960:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322bca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322bc3 expref: 13 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.680968:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322bc3 expref: 13 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.680982:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abaa1b5c600/0xcd6380150a322bca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322bc3 expref: 13 pid: 5832 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.680990:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791444.681012:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa001f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:3313:x1875683630411648:12345-0@lo:103: Request processed in 62us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791444.681017:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788791444.681107:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630411648:0@lo:103: 00000100:00100000:0.0:1788791444.681114:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630411776:0@lo:103: 00000100:00100000:2.0:1788791444.681352:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630411136:0@lo:103: 00000100:00100000:0.0:1788791444.682703:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630409856:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791444.682716:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc144700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1875683630409984:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788791444.682758:0:8446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ca3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791444.682958:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791444.683335:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606269952 00000100:00100000:3.0:1788791444.683343:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606269952 00000100:00100000:2.0:1788791444.683370:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:3.0:1788791444.683373:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba80031a00/0xcd6380150a322c6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e5d expref: 10 pid: 5832 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791444.683405:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606270080 00000100:00100000:3.0:1788791444.683409:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606270080 00010000:00010000:3.0:1788791444.683421:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba80030800/0xcd6380150a322c64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e56 expref: 11 pid: 5831 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791444.683426:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:1.0:1788791444.683436:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:2354:x1875683606269952:12345-192.168.201.29@tcp:103: 00000100:00100000:3.0:1788791444.683448:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00010000:00010000:1.0:1788791444.683450:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788791444.683453:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86258e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:2354:x1875683606270080:12345-192.168.201.29@tcp:103: 00010000:00010000:1.0:1788791444.683456:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba80031a00/0xcd6380150a322c6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e5d expref: 11 pid: 5832 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.683459:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791444.683467:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba80031a00/0xcd6380150a322c6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e5d expref: 11 pid: 5832 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.683473:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba80030800/0xcd6380150a322c64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e56 expref: 11 pid: 5831 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.683484:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba80031a00/0xcd6380150a322c6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e5d expref: 11 pid: 5832 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.683550:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba80030800/0xcd6380150a322c64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e56 expref: 10 pid: 5831 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.683573:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba80030800/0xcd6380150a322c64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e56 expref: 10 pid: 5831 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.683602:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ca3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.683610:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ca3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.683625:0:8452:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ca3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.683632:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ca3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.683639:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ca3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.683645:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ca3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.683650:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791444.683654:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ca3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791444.683661:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ca3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791444.689446:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788791444.689447:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ca3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791444.689602:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:2354:x1875683606269952:12345-192.168.201.29@tcp:103: Request processed in 6161us (6639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791444.689613:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00010000:00010000:3.0:1788791444.691846:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791444.691979:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86258e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+8:2354:x1875683606270080:12345-192.168.201.29@tcp:103: Request processed in 8519us (8603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791444.692005:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00010000:00010000:0.0:1788791444.694542:0:8446:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ca3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.694586:0:8446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ca3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791444.694593:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994ff800/0xcd6380150a322ca3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.157749:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791445.549646:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791445.549709:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791445.549747:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791445.549793:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791445.549877:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606270336 00000100:00100000:0.0:1788791445.549897:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606270336 00000100:00100000:3.0:1788791445.550004:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606270208 00000100:00100000:0.0:1788791445.550005:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:3.0:1788791445.550017:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606270208 00000100:00100000:0.0:1788791445.550030:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8625aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2352:x1875683606270336:12345-192.168.201.29@tcp:400: 00000100:00100000:3.0:1788791445.550083:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 133 00000100:00100000:3.0:1788791445.550097:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+8:2352:x1875683606270208:12345-192.168.201.29@tcp:400: 00000100:00100000:0.0:1788791445.550212:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8625aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2352:x1875683606270336:12345-192.168.201.29@tcp:400: Request processed in 186us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791445.550223:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+8:2352:x1875683606270208:12345-192.168.201.29@tcp:400: Request processed in 128us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791445.550225:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:3.0:1788791445.550240:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 133 00000100:00100000:0.0:1788791445.550284:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606270464 00000100:00100000:0.0:1788791445.550292:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606270464 00000100:00100000:0.0:1788791445.550347:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606270592 00000100:00100000:0.0:1788791445.550351:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606270592 00000100:00100000:0.0:1788791445.550374:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:0.0:1788791445.550385:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2352:x1875683606270464:12345-192.168.201.29@tcp:400: 00000100:00100000:0.0:1788791445.550430:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2352:x1875683606270464:12345-192.168.201.29@tcp:400: Request processed in 48us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791445.550438:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:0.0:1788791445.550454:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:0.0:1788791445.550464:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2352:x1875683606270592:12345-192.168.201.29@tcp:400: 00000100:00100000:0.0:1788791445.550490:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86258a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2352:x1875683606270592:12345-192.168.201.29@tcp:400: Request processed in 28us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791445.550515:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00080000:2.0:1788791445.551334:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788791445.551343:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788791445.551348:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:1.0:1788791445.859749:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788791445.859760:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ab9818e0800 from 39 10000000:01000000:1.0:1788791445.859768:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788791445.859865:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322caa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.859879:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322caa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.859892:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322caa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791445.859922:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630411904:0@lo:101: 00000100:00100000:1.0:1788791445.860042:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.860160:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbcc7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788791445.860537:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630411904 00000100:00100000:0.0:1788791445.860557:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630411904 00000100:00100000:0.0:1788791445.860629:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788791445.860640:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+12:5834:x1875683630411904:12345-0@lo:101: 00010000:00010000:0.0:1788791445.860658:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791445.860676:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994ff800/0xcd6380150a322cb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322caa expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791445.860708:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ff800/0xcd6380150a322cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322caa expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791445.860730:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994ff800/0xcd6380150a322cb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322caa expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791445.860741:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff800, rc 0) 00000100:00100000:0.0:1788791445.860805:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:5834:x1875683630411904:12345-0@lo:101: Request processed in 167us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791445.860812:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788791445.860968:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630411904:0@lo:101: 00010000:00010000:1.0:1788791445.860997:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322caa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322cb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.861009:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322caa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322cb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791445.861088:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630412032:0@lo:501: 00000100:00100000:1.0:1788791445.861121:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791445.861315:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630412032 00000100:00100000:0.0:1788791445.861321:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630412032 00000100:00100000:0.0:1788791445.861364:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788791445.861381:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:5834:x1875683630412032:12345-0@lo:501: 00000100:00100000:0.0:1788791445.873423:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:5834:x1875683630412032:12345-0@lo:501: Request processed in 12034us (12284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791445.873446:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788791445.873750:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbcc7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788791445.873794:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630412032:0@lo:501: 00000100:00100000:1.0:1788791445.873878:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630412160:0@lo:503: 00000100:00100000:1.0:1788791445.873952:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.874190:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbcc7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788791445.874264:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630412160 00000100:00100000:2.0:1788791445.874275:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630412160 00000100:00100000:2.0:1788791445.874342:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788791445.874353:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:5834:x1875683630412160:12345-0@lo:503: 00000100:00100000:2.0:1788791445.874645:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:5834:x1875683630412160:12345-0@lo:503: Request processed in 293us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791445.874654:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788791445.878798:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630412160:0@lo:503: 00000100:00100000:2.0:1788791445.881729:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba86259c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8465:1875683630412288:0@lo:502: 00000100:00100000:2.0:1788791445.881850:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791445.882003:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae03240 going to sleep for 11 seconds 00000100:00100000:0.0:1788791445.894322:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630412288 00000100:00100000:0.0:1788791445.894372:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630412288 00000100:00100000:2.0:1788791445.895995:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788791445.896012:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:8465:x1875683630412288:12345-0@lo:502: 00000100:00100000:2.0:1788791445.896959:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:8465:x1875683630412288:12345-0@lo:502: Request processed in 947us (15104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791445.896973:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788791445.897683:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba86259c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8465:1875683630412288:0@lo:502: 00000100:00100000:3.0:1788791445.897800:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb785180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8465:1875683630412416:0@lo:502: 00000100:00100000:3.0:1788791445.897883:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791445.897935:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab7a28840 going to sleep for 11 seconds 00000100:00100000:0.0:1788791445.900298:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630412416 00000100:00100000:0.0:1788791445.900321:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630412416 00000100:00100000:0.0:1788791445.900424:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788791445.900438:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:8465:x1875683630412416:12345-0@lo:502: 00000100:00100000:0.0:1788791445.900897:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:8465:x1875683630412416:12345-0@lo:502: Request processed in 462us (3013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791445.900906:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788791445.902050:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb785180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8465:1875683630412416:0@lo:502: 00000040:00080000:3.0:1788791445.902115:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788791445.902513:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788791445.902575:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788791445.902590:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322caa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322cb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.902602:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322caa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322cb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791445.902612:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788791445.902615:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788791445.902618:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788791445.902667:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c000/0xcd6380150a322cb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.902677:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c000/0xcd6380150a322cb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.902688:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c000/0xcd6380150a322cb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791445.902712:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630412544:0@lo:101: 00000100:00100000:1.0:1788791445.902791:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791445.902815:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630412544 00000100:00100000:2.0:1788791445.902824:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630412544 00000100:00100000:1.0:1788791445.902839:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbcc7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788791445.902888:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788791445.902901:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+13:5834:x1875683630412544:12345-0@lo:101: 00010000:00010000:2.0:1788791445.902916:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791445.902933:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abac2171600/0xcd6380150a322cbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322cb8 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.902964:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abac2171600/0xcd6380150a322cbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322cb8 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.902977:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abac2171600/0xcd6380150a322cbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322cb8 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.902987:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abac2171600, rc 0) 00000100:00100000:2.0:1788791445.903038:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:5834:x1875683630412544:12345-0@lo:101: Request processed in 140us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791445.903046:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788791445.903339:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630412544:0@lo:101: 00010000:00010000:1.0:1788791445.903356:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c000/0xcd6380150a322cb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322cbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.903367:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c000/0xcd6380150a322cb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322cbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791445.903427:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630412672:0@lo:501: 00000100:00100000:1.0:1788791445.903465:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.903496:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbcc7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788791445.903561:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630412672 00000100:00100000:2.0:1788791445.903566:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630412672 00000100:00100000:2.0:1788791445.903589:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788791445.903596:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:5834:x1875683630412672:12345-0@lo:501: 00000100:00100000:2.0:1788791445.904183:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:5834:x1875683630412672:12345-0@lo:501: Request processed in 584us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791445.904199:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788791445.904457:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630412672:0@lo:501: 00000100:00100000:1.0:1788791445.904508:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630412800:0@lo:503: 00000100:00100000:1.0:1788791445.904569:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.904605:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbcc7780 going to sleep for 11 seconds 00000100:00100000:3.0:1788791445.904658:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630412800 00000100:00100000:3.0:1788791445.904664:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630412800 00000100:00100000:3.0:1788791445.904707:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788791445.904726:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:5834:x1875683630412800:12345-0@lo:503: 00000100:00100000:3.0:1788791445.905946:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:5834:x1875683630412800:12345-0@lo:503: Request processed in 1224us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791445.905961:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788791445.906309:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85780000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630412800:0@lo:503: 00000100:00100000:1.0:1788791445.908109:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85780000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8466:1875683630412928:0@lo:502: 00000100:00100000:1.0:1788791445.908245:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.908340:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbcc7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788791445.910608:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630412928 00000100:00100000:0.0:1788791445.910628:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630412928 00000100:00100000:1.0:1788791445.910918:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788791445.910932:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:8466:x1875683630412928:12345-0@lo:502: 00000100:00100000:1.0:1788791445.911510:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:8466:x1875683630412928:12345-0@lo:502: Request processed in 579us (3263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791445.911520:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788791445.911874:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85780000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8466:1875683630412928:0@lo:502: 00000020:01000000:0.0:1788791445.911929:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791445.911943:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791445.911946:0:8466:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788791445.911957:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788791445.912018:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb703800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8466:1875683630413056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788791445.912077:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791445.912163:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916c5900 going to sleep for 11 seconds 00000100:00100000:2.0:1788791445.912415:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630413056 00000100:00100000:2.0:1788791445.912422:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630413056 00000100:00100000:2.0:1788791445.912476:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788791445.912487:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:8466:x1875683630413056:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788791445.912709:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:8466:x1875683630413056:12345-0@lo:502:llog_process_th.0 Request processed in 222us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791445.912859:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788791445.913034:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb703800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8466:1875683630413056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788791445.913063:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791445.913069:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791445.913072:0:8466:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788791445.913078:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788791445.913452:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788791445.913476:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788791445.913489:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c000/0xcd6380150a322cb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322cbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.913502:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c000/0xcd6380150a322cb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322cbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791445.913514:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788791445.913518:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9ababbc61000 from 39 10000000:01000000:1.0:1788791445.913521:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788791445.913579:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.913589:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.913599:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791445.913620:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630413184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788791445.913665:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.913707:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9921a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788791445.914017:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630413184 00000100:00100000:2.0:1788791445.914026:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630413184 00000100:00100000:2.0:1788791445.914119:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788791445.914162:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:5834:x1875683630413184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791445.914177:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791445.914194:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abac2171800/0xcd6380150a322ccd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322cc6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.914225:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abac2171800/0xcd6380150a322ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322cc6 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.914238:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abac2171800/0xcd6380150a322ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322cc6 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.914249:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abac2171800, rc 0) 00000100:00100000:2.0:1788791445.914304:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630413184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791445.914312:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788791445.914403:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630413184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788791445.914420:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ccd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.914430:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322ccd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791445.914512:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630413312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791445.914553:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.915650:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9921a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788791445.915802:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630413312 00000100:00100000:3.0:1788791445.915812:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630413312 00000100:00100000:3.0:1788791445.915875:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788791445.915885:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630413312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791445.917211:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630413312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1319us (2649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791445.917225:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788791445.917383:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630413312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791445.917451:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630413440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791445.917503:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.917553:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9921a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788791445.919312:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630413440 00000100:00100000:3.0:1788791445.919329:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630413440 00000100:00100000:3.0:1788791445.919402:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788791445.919413:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630413440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791445.919930:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630413440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788791445.920045:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630413440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 308us (2215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791445.920055:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788791445.921111:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8467:1875683630413568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791445.925589:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.925699:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9921a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788791445.926116:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630413568 00000100:00100000:0.0:1788791445.926348:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630413568 00000100:00100000:1.0:1788791445.926556:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788791445.926569:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:8467:x1875683630413568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791445.927248:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:8467:x1875683630413568:12345-0@lo:502:llog_process_th.0 Request processed in 679us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791445.927260:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788791445.927487:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8467:1875683630413568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788791445.927589:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb785180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8467:1875683630413696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788791445.927646:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791445.927740:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab7a28300 going to sleep for 11 seconds 00000100:00100000:1.0:1788791445.927836:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630413696 00000100:00100000:1.0:1788791445.927844:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630413696 00000100:00100000:1.0:1788791445.927899:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788791445.927909:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:8467:x1875683630413696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791445.928392:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:8467:x1875683630413696:12345-0@lo:502:llog_process_th.0 Request processed in 482us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791445.928401:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788791445.928485:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb785180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8467:1875683630413696:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788791445.928516:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788791445.928806:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788791445.928829:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788791445.928843:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ccd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.928870:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ccd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791445.928882:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788791445.928885:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788791445.928889:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788791445.928927:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d800/0xcd6380150a322cd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.928946:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d800/0xcd6380150a322cd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.928956:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d800/0xcd6380150a322cd4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791445.928977:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630413824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788791445.929021:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.929061:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbccd780 going to sleep for 11 seconds 00000100:00100000:3.0:1788791445.929212:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630413824 00000100:00100000:3.0:1788791445.929219:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630413824 00000100:00100000:3.0:1788791445.929266:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788791445.929354:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+15:5834:x1875683630413824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791445.929368:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791445.929387:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba80030c00/0xcd6380150a322cdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322cd4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791445.929415:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba80030c00/0xcd6380150a322cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322cd4 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791445.929429:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba80030c00/0xcd6380150a322cdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322cd4 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791445.929446:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba80030c00, rc 0) 00000100:00100000:3.0:1788791445.929483:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630413824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 209us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791445.929490:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788791445.929644:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630413824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788791445.929660:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d800/0xcd6380150a322cd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322cdb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.929670:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d800/0xcd6380150a322cd4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322cdb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791445.929806:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630413952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791445.929835:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.929871:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbccd780 going to sleep for 11 seconds 00000100:00100000:3.0:1788791445.929976:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630413952 00000100:00100000:3.0:1788791445.929981:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630413952 00000100:00100000:3.0:1788791445.930014:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788791445.930022:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630413952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791445.930600:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630413952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 576us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791445.930609:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788791445.930796:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630413952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791445.930846:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630414080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791445.930963:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.931026:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbccd780 going to sleep for 11 seconds 00000100:00100000:0.0:1788791445.931066:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630414080 00000100:00100000:0.0:1788791445.931079:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630414080 00000100:00100000:3.0:1788791445.931370:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788791445.931382:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630414080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788791445.931642:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630414080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 261us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791445.931650:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788791445.931785:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630414080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791445.932449:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8468:1875683630414208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791445.932514:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.932561:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba880820c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791445.932612:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630414208 00000100:00100000:2.0:1788791445.932626:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630414208 00000100:00100000:2.0:1788791445.932671:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788791445.932681:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:8468:x1875683630414208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788791445.933083:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:8468:x1875683630414208:12345-0@lo:502:llog_process_th.0 Request processed in 402us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791445.933092:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788791445.933249:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8468:1875683630414208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788791445.933555:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788791445.933567:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791445.933570:0:8468:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788791445.933575:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788791445.933610:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8468:1875683630414336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791445.933654:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.933687:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba880820c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791445.933800:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630414336 00000100:00100000:2.0:1788791445.933807:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630414336 00000100:00100000:2.0:1788791445.933959:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788791445.933971:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:8468:x1875683630414336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788791445.934637:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:8468:x1875683630414336:12345-0@lo:502:llog_process_th.0 Request processed in 665us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791445.934715:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8468:1875683630414336:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788791445.934947:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788791445.934954:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791445.934956:0:8468:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788791445.934960:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000100:00100000:2.0:1788791445.935223:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000020:01000000:3.0:1788791445.935458:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788791445.935483:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788791445.935496:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d800/0xcd6380150a322cd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322cdb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791445.935507:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d800/0xcd6380150a322cd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322cdb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791445.935518:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788791445.935531:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9aba98e4f000 from 39 10000000:01000000:3.0:1788791445.935535:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788791445.935584:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791445.935594:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791445.935604:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791445.935627:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb785f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630414464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788791445.935678:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791445.935825:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae03cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791445.935928:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630414464 00000100:00100000:2.0:1788791445.935937:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630414464 00000100:00100000:2.0:1788791445.936016:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788791445.936027:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630414464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791445.936041:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791445.936057:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abac2170200/0xcd6380150a322ce9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322ce2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.936087:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abac2170200/0xcd6380150a322ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322ce2 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.936099:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abac2170200/0xcd6380150a322ce9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322ce2 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.936111:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abac2170200, rc 0) 00000100:00100000:2.0:1788791445.936418:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630414464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 391us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791445.936426:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788791445.936567:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb785f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630414464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788791445.936587:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ce9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.936597:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322ce9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791445.936663:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630414592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791445.936697:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.936831:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba880820c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791445.936926:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630414592 00000100:00100000:2.0:1788791445.936933:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630414592 00000100:00100000:2.0:1788791445.937005:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788791445.937015:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630414592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791445.937454:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630414592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 440us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791445.937463:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788791445.937555:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630414592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791445.937611:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630414720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791445.937655:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.937782:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba880820c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791445.937962:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630414720 00000100:00100000:0.0:1788791445.937968:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630414720 00000100:00100000:0.0:1788791445.937999:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788791445.938008:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630414720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788791445.938229:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630414720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791445.938236:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788791445.938389:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630414720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791445.938833:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8469:1875683630414848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791445.938954:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.938981:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788791445.939028:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630414848 00000100:00100000:0.0:1788791445.939034:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630414848 00000100:00100000:0.0:1788791445.939064:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788791445.939072:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:8469:x1875683630414848:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788791445.939410:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:8469:x1875683630414848:12345-0@lo:502:llog_process_th.0 Request processed in 338us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791445.939419:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788791445.939515:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8469:1875683630414848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791445.939575:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8469:1875683630414976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791445.939612:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791445.939632:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788791445.939693:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630414976 00000100:00100000:2.0:1788791445.939699:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630414976 00000100:00100000:2.0:1788791445.939801:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788791445.939809:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:8469:x1875683630414976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788791445.940048:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:8469:x1875683630414976:12345-0@lo:502:llog_process_th.0 Request processed in 239us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791445.940056:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788791445.940223:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8469:1875683630414976:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788791445.940246:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788791445.940553:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788791445.940573:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788791445.940586:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ce9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.940599:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ce9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791445.940611:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788791445.940614:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788791445.940617:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788791445.940660:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.940669:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.940680:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791445.940696:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630415104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788791445.940801:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791445.940836:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba862bf780 going to sleep for 11 seconds 00000100:00100000:1.0:1788791445.940953:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630415104 00000100:00100000:1.0:1788791445.940960:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630415104 00000100:00100000:1.0:1788791445.941030:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788791445.941040:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630415104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788791445.941052:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791445.941069:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abaa1b5c200/0xcd6380150a322cf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322cf0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.941099:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abaa1b5c200/0xcd6380150a322cf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322cf0 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.941111:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abaa1b5c200/0xcd6380150a322cf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322cf0 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791445.941211:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abaa1b5c200, rc 0) 00000100:00100000:1.0:1788791445.941250:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630415104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791445.941257:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788791445.941352:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630415104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791445.941368:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322cf7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.941378:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322cf7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791445.941438:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630415232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791445.941466:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791445.941845:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba862bf780 going to sleep for 11 seconds 00000100:00100000:3.0:1788791445.941964:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630415232 00000100:00100000:3.0:1788791445.941972:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630415232 00000100:00100000:3.0:1788791445.942007:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788791445.942016:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630415232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791445.942468:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630415232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 452us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791445.942477:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788791445.942588:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630415232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791445.942635:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630415360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788791445.942684:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791445.942723:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba862bf780 going to sleep for 11 seconds 00000100:00100000:3.0:1788791445.942828:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630415360 00000100:00100000:3.0:1788791445.942834:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630415360 00000100:00100000:3.0:1788791445.942869:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788791445.942876:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630415360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788791445.943053:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630415360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791445.943060:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788791445.943216:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630415360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788791445.943943:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8470:1875683630415488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788791445.944000:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791445.944045:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae036c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791445.944161:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630415488 00000100:00100000:2.0:1788791445.944168:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630415488 00000100:00100000:2.0:1788791445.944198:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788791445.944207:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:8470:x1875683630415488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788791445.944459:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:8470:x1875683630415488:12345-0@lo:502:llog_process_th.0 Request processed in 252us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791445.944467:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788791445.944638:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8470:1875683630415488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788791445.944673:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791445.944683:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791445.944686:0:8470:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788791445.944693:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788791445.944792:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8470:1875683630415616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788791445.944832:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791445.944873:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae036c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791445.944975:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630415616 00000100:00100000:2.0:1788791445.944980:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630415616 00000100:00100000:2.0:1788791445.945004:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788791445.945011:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:8470:x1875683630415616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788791445.945217:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:8470:x1875683630415616:12345-0@lo:502:llog_process_th.0 Request processed in 205us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791445.945224:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788791445.945455:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8470:1875683630415616:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788791445.945479:0:8470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791445.945485:0:8470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791445.945487:0:8470:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788791445.945490:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788791445.945685:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788791445.945922:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788791445.945935:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322cf7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.945947:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322cf7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791445.945958:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788791445.945961:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9aba88c60000 from 1 10000000:01000000:2.0:1788791445.945964:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788791445.946000:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2171000/0xcd6380150a322cfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.946023:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abac2171000/0xcd6380150a322cfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.946034:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abac2171000/0xcd6380150a322cfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791445.946053:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630415744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788791445.946095:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791445.946162:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba862bff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791445.946268:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630415744 00000100:00100000:3.0:1788791445.946286:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630415744 00000100:00100000:3.0:1788791445.946322:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788791445.946331:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630415744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791445.946342:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791445.946358:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba80031a00/0xcd6380150a322d05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322cfe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791445.946385:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba80031a00/0xcd6380150a322d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322cfe expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791445.946397:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba80031a00/0xcd6380150a322d05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322cfe expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791445.946415:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba80031a00, rc 0) 00000100:00100000:3.0:1788791445.946453:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630415744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791445.946459:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788791445.946616:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630415744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791445.946631:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abac2171000/0xcd6380150a322cfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322d05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.946641:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abac2171000/0xcd6380150a322cfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322d05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791445.946706:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630415872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791445.946810:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791445.946837:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba862bff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791445.947066:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630415872 00000100:00100000:3.0:1788791445.947072:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630415872 00000100:00100000:3.0:1788791445.947108:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788791445.947116:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630415872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791445.947590:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630415872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 472us (777us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788791445.947600:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788791445.947677:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630415872:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788791445.947711:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788791445.947784:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2171000/0xcd6380150a322cfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322d05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791445.947794:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abac2171000/0xcd6380150a322cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322d05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791446.181924:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791447.203467:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791447.726995:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791447.727265:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606270720 00000100:00100000:2.0:1788791447.727283:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606270720 00000100:00100000:2.0:1788791447.727377:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 166 00000100:00100000:2.0:1788791447.727390:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+8:5597:x1875683606270720:12345-192.168.201.29@tcp:101: 00010000:00010000:2.0:1788791447.727413:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791447.727449:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abac2170a00/0xcd6380150a322d0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453674ebf expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791447.727488:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abac2170a00/0xcd6380150a322d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ebf expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791447.727501:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abac2170a00/0xcd6380150a322d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ebf expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791447.727538:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abac2170a00, rc 0) 00000100:00100000:2.0:1788791447.727620:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:5597:x1875683606270720:12345-192.168.201.29@tcp:101: Request processed in 232us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791447.727626:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 166 00000100:00100000:3.0:1788791447.731861:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791447.732536:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606270848 00000100:00100000:1.0:1788791447.732549:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606270848 00000100:00100000:1.0:1788791447.732615:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 167 00000100:00100000:1.0:1788791447.732625:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:5597:x1875683606270848:12345-192.168.201.29@tcp:501: 00000100:00100000:1.0:1788791447.732986:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:5597:x1875683606270848:12345-192.168.201.29@tcp:501: Request processed in 361us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791447.732995:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 167 00000100:00100000:1.0:1788791447.741218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791447.741482:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606270976 00000100:00100000:3.0:1788791447.741494:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606270976 00000100:00100000:3.0:1788791447.741560:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 168 00000100:00100000:3.0:1788791447.741571:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:5597:x1875683606270976:12345-192.168.201.29@tcp:503: 00000100:00100000:3.0:1788791447.741807:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:5597:x1875683606270976:12345-192.168.201.29@tcp:503: Request processed in 237us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791447.741815:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 168 00000100:00100000:2.0:1788791447.753063:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791447.753190:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606271104 00000100:00100000:1.0:1788791447.753205:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606271104 00000100:00100000:1.0:1788791447.753272:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 169 00000100:00100000:1.0:1788791447.753283:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:6073:x1875683606271104:12345-192.168.201.29@tcp:502: 00000100:00100000:1.0:1788791447.754716:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:6073:x1875683606271104:12345-192.168.201.29@tcp:502: Request processed in 1423us (1659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791447.754732:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 169 00000100:00100000:2.0:1788791447.775340:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791447.777925:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606271232 00000100:00100000:3.0:1788791447.777946:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606271232 00000100:00100000:3.0:1788791447.778045:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 170 00000100:00100000:3.0:1788791447.778059:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:6073:x1875683606271232:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788791447.778505:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:6073:x1875683606271232:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 447us (3179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791447.778533:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 170 00000100:00100000:2.0:1788791447.787454:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791447.787568:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606271360 00000100:00100000:1.0:1788791447.787583:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606271360 00000100:00100000:1.0:1788791447.787661:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 171 00000100:00100000:1.0:1788791447.787674:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:5597:x1875683606271360:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788791447.787713:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791447.787739:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abaa1b5c400/0xcd6380150a322d13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453674ec6 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791447.787918:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abaa1b5c400/0xcd6380150a322d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ec6 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791447.787933:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abaa1b5c400/0xcd6380150a322d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ec6 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791447.787945:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abaa1b5c400, rc 0) 00000100:00100000:1.0:1788791447.788029:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:5597:x1875683606271360:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 358us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791447.788038:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 171 00000100:00100000:1.0:1788791447.797843:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791447.798030:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606271488 00000100:00100000:2.0:1788791447.798043:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606271488 00000100:00100000:2.0:1788791447.798120:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 172 00000100:00100000:2.0:1788791447.798173:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:5597:x1875683606271488:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791447.798807:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:5597:x1875683606271488:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 634us (986us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788791447.798896:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 172 00000100:00100000:1.0:1788791447.844221:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630416000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791447.844401:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791447.845111:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630416000 00000100:00100000:0.0:1788791447.845152:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630416000 00000100:00100000:0.0:1788791447.845232:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788791447.845246:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630416000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788791447.845375:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788791447.845614:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788791447.845762:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630416128:0@lo:400:kworker.0 00000100:00100000:2.0:1788791447.845825:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791447.846239:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630416128 00000100:00100000:2.0:1788791447.846247:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630416128 00000100:00100000:2.0:1788791447.847164:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788791447.847178:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3315:x1875683630416128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791447.847275:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3315:x1875683630416128:12345-0@lo:400:kworker.0 Request processed in 100us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791447.847287:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788791447.847358:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630416128:0@lo:400:kworker.0 00000100:00100000:0.0:1788791447.849036:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630416000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3782us (4624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791447.849053:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788791447.849330:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630416640:0@lo:400:kworker.0 00000100:00100000:3.0:1788791447.849398:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791447.849434:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788791447.849441:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630416512:0@lo:400:kworker.0 00000100:00100000:3.0:1788791447.849469:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791447.851645:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630416640 00000100:00100000:3.0:1788791447.851668:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630416640 00000100:00100000:0.0:1788791447.851950:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630416384:0@lo:400:kworker.0 00000100:00100000:2.0:1788791447.851985:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630416256:0@lo:400:kworker.0 00000100:00100000:3.0:1788791447.851997:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788791447.852012:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630416640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791447.852066:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791447.852109:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb785f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630416640:12345-0@lo:400:kworker.0 Request processed in 99us (2708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791447.852154:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791447.852219:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630416512 00000100:00100000:0.0:1788791447.852227:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630416512 00000100:00100000:0.0:1788791447.852279:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788791447.852287:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630416512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791447.852328:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb785180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630416512:12345-0@lo:400:kworker.0 Request processed in 43us (2858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791447.852336:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788791447.852361:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630416256 00000100:00100000:0.0:1788791447.852366:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630416256 00000100:00080000:2.0:1788791447.852587:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788791447.852593:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791447.852617:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788791447.852636:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630416384 00000100:00100000:3.0:1788791447.852640:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630416384 00000100:00080000:2.0:1788791447.852715:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791447.852764:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788791447.852772:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788791447.852776:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8625b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630416256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791447.852786:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630416384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791447.852912:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630416384:12345-0@lo:400:kworker.0 Request processed in 130us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791447.852919:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788791447.852956:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb786a00 x1875683630416512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791447.852970:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630416512:0@lo:400:kworker.0 00000100:00100000:3.0:1788791447.852983:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630416640:0@lo:400:kworker.0 00000100:00100000:0.0:1788791447.853023:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8625b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630416256:12345-0@lo:400:kworker.0 Request processed in 249us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791447.853032:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788791447.853051:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb703800 x1875683630416000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791447.853086:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630416384:0@lo:400:kworker.0 00000100:00100000:2.0:1788791447.853422:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb784000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630416256:0@lo:400:kworker.0 00000100:00100000:1.0:1788791447.854187:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb703800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630416000:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788791448.227377:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791448.355387:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788791448.355419:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630416768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791448.355511:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791448.355658:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630416768 00000100:00100000:3.0:1788791448.355668:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630416768 00000100:00100000:3.0:1788791448.355734:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788791448.355746:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630416768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788791448.355784:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791448.355847:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630416768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791448.355855:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788791448.356057:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb701500 x1875683630416768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791448.356077:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630416768:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788791449.251537:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788791449.372040:0:8508:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf14187a0 20000000:00000080:2.0:1788791449.372071:0:8508:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9abab2f66400 uarg=0000000000000000 20000000:01000000:2.0:1788791449.372109:0:8508:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788791449.372113:0:8508:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788791449.372117:0:8508:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788791449.373816:0:8509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788791449.374494:0:8508:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788791449.380732:0:8508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788791449.380841:0:8508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788791449.380913:0:8508:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788791449.381228:0:8508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788791449.381279:0:8508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9abac2170c00/0xcd6380150a322d1a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791449.381298:0:8508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba81524000/0xcd6380150a322a8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322a88 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791449.381306:0:8508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9abac2170400/0xcd6380150a322af1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322aea expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791449.381313:0:8508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322bbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322bb5 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791449.381322:0:8508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba994fea00/0xcd6380150a322c79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e8e expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791449.381329:0:8508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9abac2170c00/0xcd6380150a322d1a lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791449.381367:0:8508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba994fea00/0xcd6380150a322c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e8e expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791449.381382:0:8508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9aba994fea00/0xcd6380150a322c79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e8e expref: 9 pid: 5832 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791449.381398:0:8508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8508:1875683630416896:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791449.381633:0:8508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322bbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322bb5 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791449.381642:0:8508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322bbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322bb5 expref: 18 pid: 5830 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791449.381659:0:8508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba86259c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8508:1875683630417024:0@lo:104: 00000100:00100000:2.0:1788791449.381698:0:8508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791449.381729:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630417024 00000100:00100000:2.0:1788791449.381737:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630417024 00000100:00100000:2.0:1788791449.381790:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788791449.381801:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:8508:x1875683630417024:12345-0@lo:104: 00010000:00010000:2.0:1788791449.381815:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba81525c00/0xcd6380150a322bb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322bbc expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791449.381870:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788791449.381877:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc136300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:8508:x1875683630417024:12345-0@lo:104: Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791449.381884:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1788791449.381887:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791449.381893:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba81525c00/0xcd6380150a322bb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322bbc expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791449.381901:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81525c00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791449.381905:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba81525c00/0xcd6380150a322bb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322bbc expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791449.381917:0:8508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9abac2170400/0xcd6380150a322af1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322aea expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791449.381919:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba81525c00/0xcd6380150a322bb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322bbc expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791449.381925:0:8508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9abac2170400/0xcd6380150a322af1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322aea expref: 18 pid: 5832 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791449.381927:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba81525c00/0xcd6380150a322bb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322bbc expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791449.381933:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788791449.381934:0:8508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc144700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8508:1875683630417152:0@lo:104: 00010000:00010000:0.0:1788791449.381968:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba81525c00/0xcd6380150a322bb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322bbc expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791449.381972:0:8508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788791449.381976:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791449.381995:0:8508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba81524000/0xcd6380150a322a8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322a88 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791449.381997:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba81525c00/0xcd6380150a322bb5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322bbc expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791449.382004:0:8508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9aba81524000/0xcd6380150a322a8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322a88 expref: 18 pid: 5830 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791449.382004:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba81525c00/0xcd6380150a322bb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322bbc expref: -99 pid: 7628 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791449.382013:0:8508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc144e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8508:1875683630417408:0@lo:104: 00010000:00010000:0.0:1788791449.382020:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791449.382022:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791449.382024:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791449.382035:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630417280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791449.382042:0:8508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791449.382062:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791449.382070:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630417152 00000100:00100000:2.0:1788791449.382073:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630417152 00000100:00100000:2.0:1788791449.382092:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630417408 00000100:00100000:2.0:1788791449.382095:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630417408 00000100:00100000:0.0:1788791449.382095:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630417280 00000100:00100000:0.0:1788791449.382097:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630417280 00000100:00100000:2.0:1788791449.382107:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788791449.382112:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e07850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+4:8508:x1875683630417152:12345-0@lo:104: 00010000:00010000:0.0:1788791449.382113:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322bbc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322bb5 expref: 19 pid: 5830 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791449.382118:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba81525600/0xcd6380150a322aea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322af1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791449.382166:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788791449.382171:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e07850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+4:8508:x1875683630417152:12345-0@lo:104: Request processed in 60us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791449.382176:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788791449.382206:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788791449.382212:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:8508:x1875683630417408:12345-0@lo:104: 00010000:00010000:2.0:1788791449.382221:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322a88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322a8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791449.382249:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788791449.382254:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:8508:x1875683630417408:12345-0@lo:104: Request processed in 43us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791449.382259:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788791449.382279:0:8508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba862bf900 going to sleep for 11 seconds 00000100:00100000:2.0:1788791449.382299:0:8508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba86259c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8508:1875683630417024:0@lo:104: 00000100:00100000:2.0:1788791449.382308:0:8508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc144700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8508:1875683630417152:0@lo:104: 00010000:00010000:1.0:1788791449.382335:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788791449.382341:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba81525600/0xcd6380150a322aea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322af1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791449.382347:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81525600 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791449.382356:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba81525600/0xcd6380150a322aea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322af1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791449.382363:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba81525600/0xcd6380150a322aea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322af1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791449.382369:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba81525600/0xcd6380150a322aea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322af1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791449.382374:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788791449.382394:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba81525600/0xcd6380150a322aea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322af1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791449.382401:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791449.382417:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba81525600/0xcd6380150a322aea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322af1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791449.382423:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba81525600/0xcd6380150a322aea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322af1 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791449.382432:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791449.382435:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322a88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322a8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791449.382439:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abaa1b5cc00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791449.382442:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322a88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322a8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791449.382448:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322a88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322a8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791449.382463:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322a88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322a8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791449.382468:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788791449.382495:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322a88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322a8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791449.382500:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791449.382507:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322a88 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322a8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791449.382514:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322a88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322a8f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791449.382526:0:8508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc144e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8508:1875683630417408:0@lo:104: 00010000:00010000:1.0:1788791449.382526:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791449.382528:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791449.382529:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791449.382539:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630417536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788791449.382566:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791449.382594:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791449.382600:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630417664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788791449.382619:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791449.382645:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630417536 00000100:00100000:1.0:1788791449.382649:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630417536 00010000:00010000:1.0:1788791449.382667:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9abac2170400/0xcd6380150a322af1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322aea expref: 20 pid: 5832 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791449.382679:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630417664 00000100:00100000:1.0:1788791449.382682:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630417664 00010000:00010000:1.0:1788791449.382701:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba81524000/0xcd6380150a322a8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322a88 expref: 21 pid: 5830 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791449.382714:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788791449.382720:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb702a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9967ad2d-016f-4163-8b2b-d5dc380f4403+21:3313:x1875683630417280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791449.382730:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791449.382735:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322bbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322bb5 expref: 21 pid: 5830 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791449.382745:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322bbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322bb5 expref: 21 pid: 5830 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791449.382757:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322bbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322bb5 expref: 21 pid: 5830 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791449.382768:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791449.382879:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788791449.382886:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+20:3314:x1875683630417536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788791449.382899:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791449.382903:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9abac2170400/0xcd6380150a322af1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322aea expref: 20 pid: 5832 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791449.382910:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9abac2170400/0xcd6380150a322af1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322aea expref: 20 pid: 5832 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791449.382920:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abac2170400/0xcd6380150a322af1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322aea expref: 20 pid: 5832 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791449.382929:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791449.382960:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630417536:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791449.382965:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788791449.382980:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788791449.382986:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:3314:x1875683630417664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788791449.382993:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791449.382996:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba81524000/0xcd6380150a322a8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322a88 expref: 18 pid: 5830 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791449.383004:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba81524000/0xcd6380150a322a8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322a88 expref: 18 pid: 5830 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791449.383013:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba81524000/0xcd6380150a322a8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322a88 expref: 18 pid: 5830 timeout: 375 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791449.383022:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791449.383043:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:3314:x1875683630417664:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791449.383059:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788791449.383101:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630417664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788791449.383109:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630417536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788791449.383438:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb702a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:3313:x1875683630417280:12345-0@lo:103:ldlm_bl.0 Request processed in 717us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791449.383446:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788791449.387971:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791449.388051:0:8508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8508:1875683630416896:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791449.388096:0:8508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9abac2170c00/0xcd6380150a322d1a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791449.388304:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606271616 00000100:00100000:3.0:1788791449.388312:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606271616 00010000:00010000:3.0:1788791449.388347:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba994fea00/0xcd6380150a322c79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e8e expref: 10 pid: 5832 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791449.388381:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:3.0:1788791449.388392:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2355:x1875683606271616:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791449.388406:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791449.388412:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba994fea00/0xcd6380150a322c79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e8e expref: 10 pid: 5832 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791449.388424:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba994fea00/0xcd6380150a322c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e8e expref: 10 pid: 5832 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791449.388442:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994fea00/0xcd6380150a322c79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e8e expref: 10 pid: 5832 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791449.388457:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9abac2170c00/0xcd6380150a322d1a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791449.388465:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abac2170c00/0xcd6380150a322d1a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791449.388499:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9abac2170c00/0xcd6380150a322d1a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791449.388813:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9abac2170c00/0xcd6380150a322d1a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791449.388821:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9abac2170c00/0xcd6380150a322d1a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791449.388828:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9abac2170c00/0xcd6380150a322d1a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791449.388835:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abac2170c00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791449.388839:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9abac2170c00/0xcd6380150a322d1a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791449.388848:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9abac2170c00/0xcd6380150a322d1a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791449.388869:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9abac2170c00/0xcd6380150a322d1a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791449.388878:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791449.388936:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:2355:x1875683606271616:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 545us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791449.388943:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00010000:00010000:2.0:1788791449.389189:0:8508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9abac2170c00/0xcd6380150a322d1a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791449.389197:0:8508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9abac2170c00/0xcd6380150a322d1a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791449.389203:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abac2170c00/0xcd6380150a322d1a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791449.392107:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630417280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788791449.392167:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791450.276335:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791450.671547:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791450.671589:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791450.671618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791450.671661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791450.671692:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606272128 00000100:00100000:2.0:1788791450.671701:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606272128 00000100:00100000:2.0:1788791450.671759:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606272000 00000100:00100000:2.0:1788791450.671763:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606272000 00000100:00100000:2.0:1788791450.671782:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1788791450.671793:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2353:x1875683606272128:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791450.671894:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2353:x1875683606272128:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 102us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791450.671902:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1788791450.671920:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:2.0:1788791450.671927:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2353:x1875683606272000:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791450.671965:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2353:x1875683606272000:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 38us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791450.671971:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:2.0:1788791450.671990:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606271744 00000100:00100000:2.0:1788791450.671993:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606271744 00000100:00100000:2.0:1788791450.672016:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 174 00000100:00100000:2.0:1788791450.672022:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:2353:x1875683606271744:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791450.672045:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:2353:x1875683606271744:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 23us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791450.672052:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 174 00000100:00080000:2.0:1788791450.672081:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788791450.672085:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788791450.672720:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606271872 00000100:00100000:3.0:1788791450.672727:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606271872 00000100:00100000:3.0:1788791450.672802:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:3.0:1788791450.672813:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2353:x1875683606271872:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791450.672864:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2353:x1875683606271872:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 52us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791450.672872:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00080000:0.0:1788791450.675068:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791450.753286:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791450.753409:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606272256 00000100:00100000:1.0:1788791450.753419:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606272256 00000100:00100000:1.0:1788791450.753481:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 175 00000100:00100000:1.0:1788791450.753492:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:5597:x1875683606272256:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788791450.753509:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791450.753533:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abaa1b5cc00/0xcd6380150a322d21 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453674ecd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791450.753560:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abaa1b5cc00/0xcd6380150a322d21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ecd expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791450.753587:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abaa1b5cc00/0xcd6380150a322d21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ecd expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791450.753596:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abaa1b5cc00, rc 0) 00000100:00100000:1.0:1788791450.753659:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:5597:x1875683606272256:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 168us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791450.753666:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 175 00000100:00100000:0.0:1788791450.758706:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791450.758784:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606272384 00000100:00100000:2.0:1788791450.758793:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606272384 00000100:00100000:2.0:1788791450.758856:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 176 00000100:00100000:2.0:1788791450.758867:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:5597:x1875683606272384:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791450.759174:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:5597:x1875683606272384:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 308us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791450.759182:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 176 00000100:00100000:0.0:1788791450.768526:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791450.768598:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606272512 00000100:00100000:3.0:1788791450.768611:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606272512 00000100:00100000:3.0:1788791450.768671:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 177 00000100:00100000:3.0:1788791450.768683:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:5597:x1875683606272512:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788791450.768982:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:5597:x1875683606272512:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 300us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791450.768991:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 177 00000100:00100000:2.0:1788791450.785692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791450.785795:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606272640 00000100:00100000:0.0:1788791450.785806:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606272640 00000100:00100000:0.0:1788791450.785862:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 178 00000100:00100000:0.0:1788791450.785873:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:6137:x1875683606272640:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788791450.786154:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:6137:x1875683606272640:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 252us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791450.786163:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 178 00000100:00100000:0.0:1788791450.795681:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791450.799654:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606272768 00000100:00100000:3.0:1788791450.799670:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606272768 00000100:00100000:3.0:1788791450.799727:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 179 00000100:00100000:3.0:1788791450.799737:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:6137:x1875683606272768:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788791450.799998:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:6137:x1875683606272768:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 260us (4325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791450.800006:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 179 10000000:01000000:2.0:1788791451.235305:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788791451.235315:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ab9818e0800 from 4 10000000:01000000:2.0:1788791451.235321:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788791451.235367:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2170c00/0xcd6380150a322d28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791451.235379:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abac2170c00/0xcd6380150a322d28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791451.235402:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abac2170c00/0xcd6380150a322d28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791451.235432:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630417792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788791451.235518:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791451.235575:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba84d0f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788791451.235633:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630417792 00000100:00100000:0.0:1788791451.235642:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630417792 00000100:00100000:0.0:1788791451.235699:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788791451.235708:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630417792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788791451.235722:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791451.235736:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994ff600/0xcd6380150a322d2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322d28 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791451.235779:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ff600/0xcd6380150a322d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322d28 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791451.235790:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994ff600/0xcd6380150a322d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322d28 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791451.235800:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff600, rc 0) 00000100:00100000:0.0:1788791451.235838:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630417792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791451.235845:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788791451.236022:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630417792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791451.236035:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abac2170c00/0xcd6380150a322d28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322d2f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791451.236043:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abac2170c00/0xcd6380150a322d28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322d2f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791451.236092:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630417920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791451.236117:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791451.236337:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba84d0f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788791451.236652:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630417920 00000100:00100000:0.0:1788791451.236659:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630417920 00000100:00100000:0.0:1788791451.236690:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788791451.236698:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630417920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788791451.237458:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630417920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 750us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791451.237467:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788791451.242509:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630417920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791451.242579:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85780700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630418048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791451.242653:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791451.242702:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd480 going to sleep for 11 seconds 00000100:00100000:3.0:1788791451.242870:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630418048 00000100:00100000:3.0:1788791451.242878:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630418048 00000100:00100000:3.0:1788791451.242931:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788791451.242941:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630418048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788791451.243164:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630418048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791451.243172:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788791451.243311:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85780700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630418048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788791451.253465:0:8587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb701500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8587:1875683630418176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788791451.253549:0:8587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791451.253597:0:8587:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788791451.253648:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630418176 00000100:00100000:2.0:1788791451.253656:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630418176 00000100:00100000:2.0:1788791451.253701:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788791451.253710:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:8587:x1875683630418176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788791451.253930:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:8587:x1875683630418176:12345-0@lo:502:llog_process_th.0 Request processed in 220us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791451.253938:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788791451.254082:0:8587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb701500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8587:1875683630418176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788791451.254110:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791451.254119:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791451.254122:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788791451.254166:0:8587:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ab9818e0800 00000020:00000080:0.0:1788791451.254169:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788791451.254252:0:8587:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb701500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8587:1875683630418304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788791451.254285:0:8587:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791451.254298:0:8587:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791451.255230:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630418304 00000100:00100000:3.0:1788791451.255244:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630418304 00000100:00100000:3.0:1788791451.255292:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788791451.255302:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:8587:x1875683630418304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788791451.255508:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:8587:x1875683630418304:12345-0@lo:502:llog_process_th.0 Request processed in 208us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791451.255516:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788791451.255613:0:8587:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb701500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8587:1875683630418304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788791451.255640:0:8587:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791451.255646:0:8587:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791451.255648:0:8587:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788791451.255653:0:8587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788791451.265477:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788791451.265514:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788791451.265527:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2170c00/0xcd6380150a322d28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322d2f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791451.265540:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abac2170c00/0xcd6380150a322d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322d2f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791451.265551:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788791451.265554:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ababbc61000 from 4 10000000:01000000:3.0:1788791451.265556:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788791451.265596:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba80030000/0xcd6380150a322d36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791451.265604:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba80030000/0xcd6380150a322d36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791451.265615:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba80030000/0xcd6380150a322d36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791451.265641:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630418432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788791451.265714:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791451.265753:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba995afa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788791451.268535:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630418432 00000100:00100000:2.0:1788791451.268550:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630418432 00000100:00100000:2.0:1788791451.268614:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788791451.268633:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630418432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791451.268654:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791451.268672:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abac2171400/0xcd6380150a322d3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322d36 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791451.268699:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abac2171400/0xcd6380150a322d3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322d36 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791451.268712:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abac2171400/0xcd6380150a322d3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322d36 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791451.268723:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abac2171400, rc 0) 00000100:00100000:2.0:1788791451.268806:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630418432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791451.268827:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788791451.275872:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630418432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791451.275905:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba80030000/0xcd6380150a322d36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322d3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791451.275917:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba80030000/0xcd6380150a322d36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322d3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791451.275997:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630418560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791451.276058:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791451.276256:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba995afa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788791451.283267:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630418560 00000100:00100000:2.0:1788791451.283284:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630418560 00000100:00100000:2.0:1788791451.283348:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788791451.283361:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630418560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791451.283665:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630418560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 307us (7606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791451.283673:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788791451.283746:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630418560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791451.288985:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630418688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788791451.289076:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791451.289211:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba84d0f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791451.289242:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630418688 00000100:00100000:2.0:1788791451.289256:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630418688 00000100:00100000:2.0:1788791451.289299:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788791451.289308:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630418688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788791451.289504:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630418688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791451.289511:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788791451.289560:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630418688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788791451.289752:0:8592:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc144a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8592:1875683630418816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788791451.292249:0:8592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791451.292304:0:8592:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba84d0f840 going to sleep for 11 seconds 00010000:00010000:3.0:1788791451.300979:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791451.303282:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630418816 00000100:00100000:0.0:1788791451.303297:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630418816 00000100:00100000:0.0:1788791451.303354:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788791451.303365:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:8592:x1875683630418816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788791451.303648:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:8592:x1875683630418816:12345-0@lo:502:llog_process_th.0 Request processed in 285us (11406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791451.303657:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788791451.305250:0:8592:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc144a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8592:1875683630418816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788791451.305297:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791451.305309:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791451.305311:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788791451.305318:0:8592:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9ababbc61000 00000020:00000080:3.0:1788791451.305321:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788791451.305416:0:8592:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb786a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8592:1875683630418944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788791451.305499:0:8592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791451.305539:0:8592:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba995af180 going to sleep for 11 seconds 00000100:00100000:3.0:1788791451.307235:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630418944 00000100:00100000:3.0:1788791451.307253:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630418944 00000100:00100000:3.0:1788791451.307316:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788791451.307326:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:8592:x1875683630418944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788791451.308524:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:8592:x1875683630418944:12345-0@lo:502:llog_process_th.0 Request processed in 1194us (3019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791451.308535:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788791451.308610:0:8592:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb786a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8592:1875683630418944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788791451.308656:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791451.308664:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791451.308667:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788791451.308672:0:8592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788791451.312201:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788791451.312234:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788791451.312249:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba80030000/0xcd6380150a322d36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322d3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791451.312261:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba80030000/0xcd6380150a322d36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322d3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791451.312273:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788791451.312276:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9aba98e4f000 from 4 10000000:01000000:2.0:1788791451.312279:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788791451.312319:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2170400/0xcd6380150a322d44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791451.312327:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abac2170400/0xcd6380150a322d44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791451.312340:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abac2170400/0xcd6380150a322d44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791451.312377:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630419072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788791451.312471:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791451.312516:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba84d0fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788791451.313047:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630419072 00000100:00100000:0.0:1788791451.313057:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630419072 00000100:00100000:0.0:1788791451.313112:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788791451.313121:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630419072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788791451.313149:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791451.313162:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994fee00/0xcd6380150a322d4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322d44 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791451.313185:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994fee00/0xcd6380150a322d4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322d44 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791451.313195:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994fee00/0xcd6380150a322d4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322d44 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791451.313216:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fee00, rc 0) 00000100:00100000:0.0:1788791451.313274:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630419072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791451.313280:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788791451.313514:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc144a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630419072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791451.313531:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abac2170400/0xcd6380150a322d44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322d4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791451.313541:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abac2170400/0xcd6380150a322d44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322d4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791451.313602:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb786a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630419200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791451.313633:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791451.313663:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba995af180 going to sleep for 11 seconds 00000100:00100000:0.0:1788791451.314269:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630419200 00000100:00100000:0.0:1788791451.314275:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630419200 00000100:00100000:0.0:1788791451.314960:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788791451.314972:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630419200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788791451.315291:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630419200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 320us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791451.315298:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788791451.328320:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb786a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630419200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788791451.328405:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb701500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630419328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788791451.328525:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791451.328616:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082300 going to sleep for 11 seconds 00000100:00100000:2.0:1788791451.336537:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630419328 00000100:00100000:2.0:1788791451.336554:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630419328 00000100:00100000:2.0:1788791451.337046:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788791451.337057:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630419328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788791451.337348:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630419328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 291us (8822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791451.337355:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788791451.337765:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb701500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630419328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791451.347374:0:8594:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85780700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8594:1875683630419456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791451.347473:0:8594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791451.347516:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630419456 00000100:00100000:1.0:1788791451.347524:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630419456 00000100:00100000:1.0:1788791451.347580:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788791451.347590:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:8594:x1875683630419456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791451.347813:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:8594:x1875683630419456:12345-0@lo:502:llog_process_th.0 Request processed in 223us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791451.347821:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788791451.347872:0:8594:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791451.347894:0:8594:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85780700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8594:1875683630419456:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788791451.347932:0:8594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788791451.347943:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791451.347946:0:8594:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788791451.347952:0:8594:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9aba98e4f000 00000020:00000080:1.0:1788791451.347954:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788791451.348300:0:8594:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85780700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8594:1875683630419584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791451.348340:0:8594:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791451.348371:0:8594:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791451.350172:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630419584 00000100:00100000:2.0:1788791451.350186:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630419584 00000100:00100000:2.0:1788791451.350238:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788791451.350248:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:8594:x1875683630419584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788791451.350505:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:8594:x1875683630419584:12345-0@lo:502:llog_process_th.0 Request processed in 258us (2164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791451.350513:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788791451.351553:0:8594:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85780700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:8594:1875683630419584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788791451.351589:0:8594:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788791451.351597:0:8594:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791451.351600:0:8594:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788791451.351604:0:8594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788791451.351861:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788791451.351882:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788791451.351893:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2170400/0xcd6380150a322d44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322d4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791451.351903:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abac2170400/0xcd6380150a322d44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322d4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791452.323444:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791452.967503:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630419712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791452.967583:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791452.968120:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630419712 00000100:00100000:0.0:1788791452.968190:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630419712 00000100:00100000:0.0:1788791452.968258:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788791452.968268:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630419712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788791452.968307:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791452.968360:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630419712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791452.968367:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788791452.968426:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba85780700 x1875683630419712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791452.968447:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630419712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791452.968832:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630419840:0@lo:400:kworker.0 00000100:00100000:2.0:1788791452.968874:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791452.968903:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630420352:0@lo:400:kworker.0 00000100:00100000:2.0:1788791452.968978:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791452.969001:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788791452.969007:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630420224:0@lo:400:kworker.0 00000100:00100000:2.0:1788791452.969031:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791452.969064:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630419968:0@lo:400:kworker.0 00000100:00100000:2.0:1788791452.969090:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791452.969110:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791452.969115:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba86259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630420096:0@lo:400:kworker.0 00000100:00100000:2.0:1788791452.969167:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791452.969196:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630419840 00000100:00100000:2.0:1788791452.969201:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630419840 00000100:00100000:2.0:1788791452.969233:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788791452.969241:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630419840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791452.969280:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630419840:12345-0@lo:400:kworker.0 Request processed in 40us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791452.969286:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788791452.969314:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630420352 00000100:00100000:2.0:1788791452.969317:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630420352 00000100:00100000:2.0:1788791452.969344:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630419968 00000100:00100000:2.0:1788791452.969347:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630419968 00000100:00100000:2.0:1788791452.969357:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630420096 00000100:00100000:2.0:1788791452.969360:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630420096 00000100:00100000:2.0:1788791452.969374:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788791452.969380:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630420352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791452.969409:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630420352:12345-0@lo:400:kworker.0 Request processed in 29us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791452.969415:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788791452.969441:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788791452.969447:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630419968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791452.969480:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630419968:12345-0@lo:400:kworker.0 Request processed in 33us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791452.969494:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788791452.969505:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788791452.969510:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630420096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791452.969533:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630420096:12345-0@lo:400:kworker.0 Request processed in 23us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791452.969538:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788791452.969553:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630420224 00000100:00100000:2.0:1788791452.969556:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630420224 00000100:00100000:2.0:1788791452.969577:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788791452.969582:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630420224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791452.969605:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630420224:12345-0@lo:400:kworker.0 Request processed in 23us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791452.969611:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788791452.969648:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba86259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630420096:0@lo:400:kworker.0 00000100:00100000:2.0:1788791452.969656:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630419968:0@lo:400:kworker.0 00010000:00080000:2.0:1788791452.969680:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababc136300 x1875683630420224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791452.969689:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630420224:0@lo:400:kworker.0 00000100:00100000:2.0:1788791452.969697:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc144a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630419840:0@lo:400:kworker.0 00000100:00100000:2.0:1788791452.969704:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630420352:0@lo:400:kworker.0 00000100:00080000:3.0:1788791452.969859:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788791452.969864:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788791452.969866:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788791453.347278:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791453.482164:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788791453.482188:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630420480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791453.482258:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791453.482329:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630420480 00000100:00100000:0.0:1788791453.482336:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630420480 00000100:00100000:0.0:1788791453.482394:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788791453.482403:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630420480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788791453.482448:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791453.482493:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb702300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630420480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791453.482500:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788791453.482539:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb701500 x1875683630420480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791453.482557:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630420480:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788791454.373503:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791455.401239:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791455.790613:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791455.790655:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791455.790684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791455.790718:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791455.790749:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606273152 00000100:00100000:0.0:1788791455.790760:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606273152 00000100:00100000:0.0:1788791455.790832:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606273280 00000100:00100000:0.0:1788791455.790835:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606273280 00000100:00100000:0.0:1788791455.790854:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:0.0:1788791455.790863:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2352:x1875683606273152:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791455.790937:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb701500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2352:x1875683606273152:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 75us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791455.790946:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:0.0:1788791455.790962:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1788791455.790969:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2352:x1875683606273280:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791455.790991:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb702d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2352:x1875683606273280:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 23us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791455.790997:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1788791455.791013:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606273024 00000100:00100000:0.0:1788791455.791016:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606273024 00000100:00100000:0.0:1788791455.791043:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:0.0:1788791455.791049:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2352:x1875683606273024:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791455.791076:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb700380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2352:x1875683606273024:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 27us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791455.791083:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00080000:0.0:1788791455.791102:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788791455.791113:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788791455.791115:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788791455.791504:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606272896 00000100:00100000:1.0:1788791455.791510:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606272896 00000100:00100000:1.0:1788791455.791546:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 196 00000100:00100000:1.0:1788791455.791554:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2352:x1875683606272896:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791455.791601:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2352:x1875683606272896:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 48us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791455.791608:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 196 00000001:02000400:3.0:1788791456.292084:0:8811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788791456.420068:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791457.444366:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791458.083365:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791458.083388:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630420608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791458.083456:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791458.083560:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630420608 00000100:00100000:2.0:1788791458.083570:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630420608 00000100:00100000:2.0:1788791458.083653:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788791458.083673:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630420608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788791458.083708:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788791458.083754:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788791458.083759:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630420608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791458.084001:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630421120:0@lo:400:kworker.0 00000100:00100000:3.0:1788791458.084037:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791458.084060:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788791458.084067:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630420992:0@lo:400:kworker.0 00000100:00100000:3.0:1788791458.084161:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791458.084189:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630421120 00000100:00100000:3.0:1788791458.084200:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630421120 00000100:00100000:3.0:1788791458.084240:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788791458.084246:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630421120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791458.084284:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb787100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630421120:12345-0@lo:400:kworker.0 Request processed in 38us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791458.084290:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788791458.084308:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788791458.084343:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb784380 x1875683630421120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791458.084356:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb784380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630421120:0@lo:400:kworker.0 00000100:00100000:3.0:1788791458.084389:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb786680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630420736:0@lo:400:kworker.0 00000100:00100000:3.0:1788791458.084417:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791458.084441:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630421248:0@lo:400:kworker.0 00000100:00100000:3.0:1788791458.084461:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791458.084485:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788791458.084491:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630420864:0@lo:400:kworker.0 00000100:00100000:3.0:1788791458.085368:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788791458.085466:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba85780a80 x1875683630420608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791458.085486:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630420608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791458.085542:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630420736 00000100:00100000:3.0:1788791458.085547:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630420736 00000100:00100000:3.0:1788791458.085585:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788791458.085593:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3312:x1875683630420736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791458.085723:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3312:x1875683630420736:12345-0@lo:400:kworker.0 Request processed in 130us (1304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791458.085737:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788791458.086341:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb786680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630420736:0@lo:400:kworker.0 00000100:00100000:1.0:1788791458.086513:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630420992 00000100:00100000:1.0:1788791458.086521:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630420992 00000100:00100000:1.0:1788791458.086569:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630421248 00000100:00100000:1.0:1788791458.086572:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630421248 00000100:00100000:1.0:1788791458.086587:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630420864 00000100:00100000:1.0:1788791458.086590:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630420864 00000100:00100000:1.0:1788791458.086604:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788791458.086623:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630420992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791458.086751:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788791458.086760:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630421248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791458.086814:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb784380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630421248:12345-0@lo:400:kworker.0 Request processed in 56us (2352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791458.086821:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788791458.086838:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788791458.086844:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630420864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791458.086872:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb784a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630420864:12345-0@lo:400:kworker.0 Request processed in 29us (1507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791458.086878:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788791458.086895:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791458.086930:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb786a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630420864:0@lo:400:kworker.0 00000100:00100000:0.0:1788791458.086941:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb786d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630421248:0@lo:400:kworker.0 00000100:00100000:1.0:1788791458.087245:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb787480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630420992:12345-0@lo:400:kworker.0 Request processed in 632us (3082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791458.087252:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788791458.087475:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630420992:0@lo:400:kworker.0 00000100:00100000:2.0:1788791458.087772:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1788791458.467389:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791458.602342:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788791458.602367:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630421376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791458.602442:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791458.602512:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630421376 00000100:00100000:1.0:1788791458.602520:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630421376 00000100:00100000:1.0:1788791458.602570:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788791458.602578:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630421376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788791458.602613:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791458.602658:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630421376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791458.602665:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788791458.602706:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba85782d80 x1875683630421376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791458.602724:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630421376:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788791459.492532:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791460.515276:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791460.921202:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791460.921323:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606273408 00000100:00100000:2.0:1788791460.921334:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606273408 00000100:00100000:2.0:1788791460.921397:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 198 00000100:00100000:2.0:1788791460.921408:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2355:x1875683606273408:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791460.921474:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2355:x1875683606273408:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 68us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791460.921482:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 198 00000100:00100000:3.0:1788791460.926602:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791460.926779:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606273536 00000100:00100000:1.0:1788791460.926789:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606273536 00000100:00100000:1.0:1788791460.926959:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:1.0:1788791460.926971:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606273536:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791460.927046:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb784000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606273536:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 78us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791460.927053:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00080000:3.0:1788791460.927711:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791460.939085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791460.939148:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791460.939178:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606273664 00000100:00100000:3.0:1788791460.939187:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606273664 00000100:00100000:3.0:1788791460.939242:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606273792 00000100:00100000:3.0:1788791460.939245:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606273792 00000100:00100000:3.0:1788791460.939264:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788791460.939274:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2351:x1875683606273664:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:3.0:1788791460.939321:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322c87 00000100:00080000:3.0:1788791460.939331:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9ababb5a4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788791460.939370:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788791460.940151:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+2:2351:x1875683606273664:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 875us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791460.940161:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788791460.940180:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1788791460.940188:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2351:x1875683606273792:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:3.0:1788791460.940206:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322c8e 00000100:00080000:3.0:1788791460.940214:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9abab306f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788791460.940238:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788791460.940430:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb787b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+2:2351:x1875683606273792:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 243us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791460.940437:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00080000:3.0:1788791460.940464:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788791460.940468:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788791460.941168:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791460.941860:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788791461.319117:0:9056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing yml_node 00010000:00010000:0.0:1788791461.541346:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791462.563294:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791463.205695:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788791463.205720:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630421504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791463.205789:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791463.205895:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630421504 00000100:00100000:1.0:1788791463.205903:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630421504 00000100:00100000:1.0:1788791463.205962:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788791463.205971:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630421504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788791463.206006:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791463.206052:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb703100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630421504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791463.206059:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788791463.206101:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba85782d80 x1875683630421504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791463.206120:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630421504:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788791463.206212:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788791463.211223:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630421632:0@lo:400:kworker.0 00000100:00100000:1.0:1788791463.211312:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791463.211840:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630421632 00000100:00100000:3.0:1788791463.211849:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630421632 00000100:00100000:3.0:1788791463.211896:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788791463.211906:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3315:x1875683630421632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791463.216248:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630422016:0@lo:400:kworker.0 00000100:00100000:2.0:1788791463.216322:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791463.216364:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791463.216371:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630422144:0@lo:400:kworker.0 00000100:00100000:2.0:1788791463.216396:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791463.216446:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630422144 00000100:00100000:2.0:1788791463.216454:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630422144 00000100:00100000:2.0:1788791463.216523:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788791463.216533:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630422144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791463.216590:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630422144:12345-0@lo:400:kworker.0 Request processed in 58us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791463.216597:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788791463.216634:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630422144:0@lo:400:kworker.0 00000100:00100000:2.0:1788791463.216687:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630422016 00000100:00100000:2.0:1788791463.216691:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630422016 00000100:00100000:2.0:1788791463.216718:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788791463.216724:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630422016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791463.216757:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630422016:12345-0@lo:400:kworker.0 Request processed in 33us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791463.216763:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788791463.216780:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630421888:0@lo:400:kworker.0 00000100:00100000:2.0:1788791463.216801:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791463.216818:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788791463.216823:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630421760:0@lo:400:kworker.0 00000100:00100000:2.0:1788791463.216841:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791463.216862:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630421888 00000100:00100000:2.0:1788791463.216865:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630421888 00000100:00100000:2.0:1788791463.216882:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630421760 00000100:00100000:2.0:1788791463.216884:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630421760 00000100:00100000:2.0:1788791463.216896:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788791463.216901:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630421888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791463.216929:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630421888:12345-0@lo:400:kworker.0 Request processed in 27us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791463.216934:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788791463.216942:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788791463.216947:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630421760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791463.216968:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630421760:12345-0@lo:400:kworker.0 Request processed in 20us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791463.216973:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788791463.217004:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630421760:0@lo:400:kworker.0 00000100:00100000:2.0:1788791463.217013:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630421888:0@lo:400:kworker.0 00010000:00080000:2.0:1788791463.217036:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababbfdbb80 x1875683630422016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791463.217046:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630422016:0@lo:400:kworker.0 00000100:00080000:2.0:1788791463.217089:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788791463.217093:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791463.225554:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3315:x1875683630421632:12345-0@lo:400:kworker.0 Request processed in 13637us (14229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791463.225571:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788791463.225779:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630421632:0@lo:400:kworker.0 00000001:00100000:0.0:1788791463.280525:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00000020:00000080:0.0:1788791463.280536:0:6705:0:(genops.c:885:class_export_put()) final put ffff9ababb5a6000/aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00000020:00000080:0.0:1788791463.280642:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababb5a6000/aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 for lustre-OST0000 00000020:00000080:0.0:1788791463.280690:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ababb5a4000 for lustre-OST0000 00010000:00010000:0.0:1788791463.588170:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791463.716927:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788791463.716952:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630422272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788791463.717026:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791463.717305:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630422272 00000100:00100000:1.0:1788791463.717315:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630422272 00000100:00100000:1.0:1788791463.717373:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788791463.717383:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630422272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788791463.717439:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791463.717508:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb786d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630422272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791463.717516:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788791463.717564:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba85782d80 x1875683630422272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791463.717583:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630422272:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788791464.612294:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788791465.370355:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00000020:00000080:3.0:1788791465.370366:0:7644:0:(genops.c:885:class_export_put()) final put ffff9abab306a800/aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00000020:00000080:0.0:1788791465.370391:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9abab306a800/aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 for lustre-OST0001 00000020:00000080:0.0:1788791465.370441:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9abab306f000 for lustre-OST0001 00010000:00010000:0.0:1788791465.635349:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788791465.641808:0:9248:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.82 00000100:00100000:0.0:1788791466.034458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791466.034502:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791466.034565:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606273920 00000100:00100000:3.0:1788791466.034574:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606273920 00000100:00100000:3.0:1788791466.034621:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 200 00000100:00100000:3.0:1788791466.034629:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2352:x1875683606273920:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791466.034694:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2352:x1875683606273920:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 65us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791466.034712:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 200 00000100:00100000:2.0:1788791466.036610:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606274048 00000100:00100000:2.0:1788791466.036621:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606274048 00000100:00100000:2.0:1788791466.036690:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:2.0:1788791466.036700:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2352:x1875683606274048:12345-192.168.201.29@tcp:400:kworker.0 00000100:00080000:3.0:1788791466.036864:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791466.037101:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2352:x1875683606274048:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 401us (2596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791466.037109:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00010000:00010000:3.0:1788791466.660288:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791467.683762:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791468.324446:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788791468.324486:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630422400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791468.324561:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791468.324636:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630422400 00000100:00100000:1.0:1788791468.324646:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630422400 00000100:00100000:1.0:1788791468.324714:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788791468.324859:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630422400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788791468.324898:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791468.324946:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630422400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 223us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791468.324955:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788791468.324978:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788791468.325010:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba85782d80 x1875683630422400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791468.325029:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630422400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791468.325620:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630422528:0@lo:400:kworker.0 00000100:00100000:1.0:1788791468.325659:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791468.325686:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630423040:0@lo:400:kworker.0 00000100:00100000:1.0:1788791468.325710:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791468.325837:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630422912:0@lo:400:kworker.0 00000100:00100000:1.0:1788791468.325894:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791468.325900:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630422656:0@lo:400:kworker.0 00000100:00100000:0.0:1788791468.333349:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630423040 00000100:00100000:0.0:1788791468.333367:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630423040 00000100:00100000:0.0:1788791468.333448:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788791468.333472:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630423040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791468.333813:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630422528 00000100:00100000:3.0:1788791468.333819:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630422528 00000100:00100000:3.0:1788791468.333866:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788791468.333875:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630422528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791468.333935:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630422528:12345-0@lo:400:kworker.0 Request processed in 61us (8275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791468.333942:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788791468.334006:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791468.334038:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630422912 00000100:00100000:3.0:1788791468.334042:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630422912 00000100:00100000:3.0:1788791468.334071:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788791468.334078:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630422912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791468.334112:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb786a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630422912:12345-0@lo:400:kworker.0 Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791468.334118:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788791468.337442:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba85781500 x1875683630422912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791468.337472:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630422912:0@lo:400:kworker.0 00000100:00100000:3.0:1788791468.337496:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788791468.337507:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630422784:0@lo:400:kworker.0 00000100:00100000:3.0:1788791468.337573:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791468.337635:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630422784 00000100:00100000:3.0:1788791468.337642:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630422784 00000100:00100000:3.0:1788791468.337688:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788791468.337697:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630422784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791468.337932:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb786680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630422784:12345-0@lo:400:kworker.0 Request processed in 234us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791468.337939:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788791468.337972:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630422784:0@lo:400:kworker.0 00000100:00080000:1.0:1788791468.343365:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788791468.343376:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791468.343420:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791468.343579:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630422656 00000100:00100000:3.0:1788791468.343588:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630422656 00000100:00100000:3.0:1788791468.343641:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788791468.343650:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630422656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791468.343706:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630422656:12345-0@lo:400:kworker.0 Request processed in 57us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791468.343713:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788791468.343949:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630422528:0@lo:400:kworker.0 00000100:00100000:1.0:1788791468.343983:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85780700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630422656:0@lo:400:kworker.0 00000100:00100000:0.0:1788791468.346334:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630423040:12345-0@lo:400:kworker.0 Request processed in 12867us (20612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791468.346349:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788791468.346568:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630423040:0@lo:400:kworker.0 00000001:02000400:0.0:1788791468.590389:0:9346:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.82 00010000:00010000:3.0:1788791468.707915:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791468.836104:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8627aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630423168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788791468.836216:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791468.836336:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630423168 00000100:00100000:3.0:1788791468.836345:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630423168 00000100:00100000:3.0:1788791468.836399:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788791468.836408:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630423168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788791468.836446:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791468.836504:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630423168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791468.836511:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788791468.838063:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba8627aa00 x1875683630423168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791468.838090:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8627aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630423168:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788791469.734756:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791470.758220:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788791471.027824:0:9443:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.82 00000100:00100000:1.0:1788791471.166578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791471.166620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791471.166659:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606274176 00000100:00100000:1.0:1788791471.166671:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606274176 00000100:00100000:1.0:1788791471.167155:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 202 00000100:00100000:1.0:1788791471.167167:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2355:x1875683606274176:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791471.167239:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2355:x1875683606274176:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 74us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791471.167247:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 202 00000100:00100000:2.0:1788791471.170597:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606274304 00000100:00100000:2.0:1788791471.170613:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606274304 00000100:00100000:2.0:1788791471.170750:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:2.0:1788791471.170762:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606274304:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791471.170868:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606274304:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 108us (4246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791471.170889:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00080000:1.0:1788791471.175532:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788791471.782369:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788791472.769956:0:9491:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 10:31:11 EDT 2026 00010000:00010000:0.0:1788791472.807623:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791473.445158:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630423552:0@lo:400:kworker.0 00000100:00100000:1.0:1788791473.445230:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791473.445295:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791473.445302:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630423680:0@lo:400:kworker.0 00000100:00100000:1.0:1788791473.445331:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791473.445370:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630423552 00000100:00100000:1.0:1788791473.445378:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630423552 00000100:00100000:1.0:1788791473.445434:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788791473.445444:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630423552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791473.445513:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630423552:12345-0@lo:400:kworker.0 Request processed in 71us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791473.445522:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788791473.445545:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791473.445574:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630423552:0@lo:400:kworker.0 00000100:00100000:3.0:1788791473.445683:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630423296:0@lo:400:kworker.0 00000100:00100000:3.0:1788791473.445718:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791473.445760:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630423808:0@lo:400:kworker.0 00000100:00100000:3.0:1788791473.445783:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791473.445799:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788791473.445804:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630423424:0@lo:400:kworker.0 00000100:00100000:3.0:1788791473.445822:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791473.445836:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630423936:0@lo:400:kworker.0 00000100:00100000:3.0:1788791473.445853:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791473.445883:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630423680 00000100:00100000:3.0:1788791473.445887:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630423680 00000100:00100000:3.0:1788791473.445919:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630423936 00000100:00100000:3.0:1788791473.445922:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630423936 00000100:00100000:3.0:1788791473.445937:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788791473.445943:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630423680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791473.445978:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630423680:12345-0@lo:400:kworker.0 Request processed in 36us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791473.445984:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788791473.445997:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788791473.446003:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630423936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791473.446034:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630423936:12345-0@lo:400:kworker.0 Request processed in 31us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791473.446040:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788791473.446081:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba85782300 x1875683630423936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791473.446092:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630423936:0@lo:400:kworker.0 00000100:00100000:2.0:1788791473.446211:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630423808 00000100:00100000:2.0:1788791473.446215:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630423808 00000100:00100000:2.0:1788791473.446238:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630423424 00000100:00100000:2.0:1788791473.446240:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630423424 00000100:00100000:2.0:1788791473.446255:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788791473.446262:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630423808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791473.446301:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630423808:12345-0@lo:400:kworker.0 Request processed in 40us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791473.446307:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788791473.446320:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788791473.446327:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630423424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791473.446353:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630423424:12345-0@lo:400:kworker.0 Request processed in 27us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791473.446359:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788791473.446383:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630423424:0@lo:400:kworker.0 00000100:00100000:2.0:1788791473.446393:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630423808:0@lo:400:kworker.0 00000100:00100000:3.0:1788791473.447080:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788791473.447096:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630424064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791473.447159:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791473.447189:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630424064 00000100:00100000:3.0:1788791473.447195:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630424064 00000100:00100000:3.0:1788791473.447224:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788791473.447232:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8627b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630424064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788791473.447260:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791473.447307:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8627b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630424064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791473.447314:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788791473.447415:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababbfd9f80 x1875683630424064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791473.447432:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630424064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791473.448219:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630423296 00000100:00100000:1.0:1788791473.448226:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630423296 00000100:00100000:1.0:1788791473.448271:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788791473.448279:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3312:x1875683630423296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791473.448337:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3312:x1875683630423296:12345-0@lo:400:kworker.0 Request processed in 59us (2618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791473.448343:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:1.0:1788791473.448371:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788791473.448377:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788791473.448380:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791473.448388:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630423296:0@lo:400:kworker.0 00010000:00080000:1.0:1788791473.448399:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba85781c00 x1875683630423680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791473.448409:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630423680:0@lo:400:kworker.0 00010000:00010000:2.0:1788791473.829849:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791473.955564:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630424192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788791473.955640:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791473.965460:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630424192 00000100:00100000:2.0:1788791473.965473:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630424192 00000100:00100000:2.0:1788791473.965527:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788791473.965537:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630424192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788791473.965572:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791473.965652:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630424192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (10012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791473.965659:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788791473.965698:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb701c00 x1875683630424192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791473.965717:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630424192:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788791474.855263:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791475.876907:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791476.271286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791476.271364:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791476.271542:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606274432 00000100:00100000:0.0:1788791476.271552:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606274432 00000100:00100000:0.0:1788791476.271598:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 204 00000100:00100000:0.0:1788791476.271608:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2353:x1875683606274432:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791476.271675:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2353:x1875683606274432:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 67us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791476.271682:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 204 00000100:00100000:3.0:1788791476.273304:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606274560 00000100:00100000:3.0:1788791476.273317:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606274560 00000100:00100000:3.0:1788791476.273443:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:3.0:1788791476.273455:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2353:x1875683606274560:12345-192.168.201.29@tcp:400:kworker.0 00000100:00080000:1.0:1788791476.273516:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791476.273527:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2353:x1875683606274560:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 75us (2251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791476.273546:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00010000:00010000:0.0:1788791476.899293:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791477.923273:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791478.564379:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630424320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791478.564604:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791478.564819:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630424320 00000100:00100000:0.0:1788791478.564830:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630424320 00000100:00100000:0.0:1788791478.564897:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788791478.564908:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630424320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788791478.564953:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791478.565015:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb701180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630424320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791478.565024:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788791478.565049:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788791478.565086:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb702680 x1875683630424320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791494 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791478.565108:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630424320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791478.576017:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630424576:0@lo:400:kworker.0 00000100:00100000:2.0:1788791478.576116:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791478.576192:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791478.576198:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630424704:0@lo:400:kworker.0 00000100:00100000:2.0:1788791478.576222:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791478.576265:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630424576 00000100:00100000:2.0:1788791478.576273:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630424576 00000100:00100000:2.0:1788791478.576329:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630424704 00000100:00100000:2.0:1788791478.576332:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630424704 00000100:00100000:2.0:1788791478.576366:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788791478.576375:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630424576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791478.576446:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630424576:12345-0@lo:400:kworker.0 Request processed in 72us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791478.576454:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788791478.576484:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788791478.576491:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630424704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791478.576514:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630424704:12345-0@lo:400:kworker.0 Request processed in 24us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791478.576520:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788791478.576562:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630424704:0@lo:400:kworker.0 00000100:00100000:2.0:1788791478.576572:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630424576:0@lo:400:kworker.0 00000100:00100000:2.0:1788791478.576595:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630424832:0@lo:400:kworker.0 00000100:00100000:2.0:1788791478.576620:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791478.576639:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788791478.576645:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630424448:0@lo:400:kworker.0 00000100:00100000:2.0:1788791478.576670:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791478.576694:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630424960:0@lo:400:kworker.0 00000100:00100000:2.0:1788791478.576710:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791478.576726:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630424960 00000100:00100000:2.0:1788791478.576729:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630424960 00000100:00100000:2.0:1788791478.576748:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788791478.576753:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630424960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791478.576779:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630424960:12345-0@lo:400:kworker.0 Request processed in 26us (68us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791478.576785:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788791478.576814:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630424960:0@lo:400:kworker.0 00000100:00100000:3.0:1788791478.577857:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630424832 00000100:00100000:3.0:1788791478.577867:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630424832 00000100:00100000:3.0:1788791478.577919:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788791478.577928:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630424832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791478.579412:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630424832:12345-0@lo:400:kworker.0 Request processed in 97us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791478.579426:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788791478.579465:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630424448 00000100:00100000:3.0:1788791478.579538:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630424448 00000100:00080000:0.0:1788791478.579715:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788791478.579722:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791478.579815:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788791478.579827:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3312:x1875683630424448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791478.579898:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3312:x1875683630424448:12345-0@lo:400:kworker.0 Request processed in 75us (3227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791478.579923:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788791478.580014:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630424448:0@lo:400:kworker.0 00010000:00080000:3.0:1788791478.580110:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababbfdb800 x1875683630424832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791478.581090:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630424832:0@lo:400:kworker.0 00010000:00010000:0.0:1788791478.950414:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791479.085727:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba86278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630425088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788791479.085800:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791479.085881:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630425088 00000100:00100000:2.0:1788791479.085889:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630425088 00000100:00100000:2.0:1788791479.085934:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788791479.085942:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630425088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788791479.085990:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791479.086033:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630425088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791479.086040:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788791479.087614:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba86278700 x1875683630425088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791479.087641:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba86278700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630425088:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788791479.977454:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791480.995393:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791481.389168:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791481.389219:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791481.389340:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606274688 00000100:00100000:2.0:1788791481.389351:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606274688 00000100:00100000:2.0:1788791481.389410:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 206 00000100:00100000:2.0:1788791481.389421:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2355:x1875683606274688:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791481.389514:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2355:x1875683606274688:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 96us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791481.389522:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 206 00000100:00100000:3.0:1788791481.390033:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606274816 00000100:00100000:3.0:1788791481.390039:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606274816 00000100:00100000:3.0:1788791481.390087:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:3.0:1788791481.390187:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606274816:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791481.390231:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606274816:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 46us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791481.390244:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00080000:3.0:1788791481.390261:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788791482.019229:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791483.045391:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791483.683745:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788791483.683840:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788791483.683862:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630425344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791483.683944:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791483.685568:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630425344 00000100:00100000:2.0:1788791483.685582:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630425344 00000100:00100000:2.0:1788791483.685648:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788791483.685668:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630425344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788791483.685703:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791483.685766:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb701f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630425344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791483.685773:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788791483.685816:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb702680 x1875683630425344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791499 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791483.685834:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb702680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630425344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791483.686423:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630425472:0@lo:400:kworker.0 00000100:00100000:2.0:1788791483.686474:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791483.686509:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630425472 00000100:00100000:2.0:1788791483.686513:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630425472 00000100:00100000:2.0:1788791483.686542:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788791483.686548:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630425472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791483.686582:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630425472:12345-0@lo:400:kworker.0 Request processed in 34us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791483.686589:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788791483.686617:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630425472:0@lo:400:kworker.0 00000100:00080000:2.0:1788791483.695520:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788791483.702289:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630425600:0@lo:400:kworker.0 00000100:00100000:3.0:1788791483.702365:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791483.702417:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630425600 00000100:00100000:3.0:1788791483.702425:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630425600 00000100:00100000:3.0:1788791483.702858:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788791483.702869:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630425600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791483.702953:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630425600:12345-0@lo:400:kworker.0 Request processed in 87us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791483.702961:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788791483.702982:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791483.703011:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630425600:0@lo:400:kworker.0 00000100:00100000:3.0:1788791483.703019:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630425216:0@lo:400:kworker.0 00000100:00100000:3.0:1788791483.703054:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791483.703074:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630425216 00000100:00100000:3.0:1788791483.703077:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630425216 00000100:00100000:3.0:1788791483.703101:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788791483.703107:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630425216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791483.703158:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630425216:12345-0@lo:400:kworker.0 Request processed in 52us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791483.703164:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788791483.703548:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630425216:0@lo:400:kworker.0 00000100:00100000:1.0:1788791483.704306:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630425856:0@lo:400:kworker.0 00000100:00100000:1.0:1788791483.704347:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791483.704562:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630425728:0@lo:400:kworker.0 00000100:00100000:2.0:1788791483.704596:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791483.704628:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630425728 00000100:00100000:2.0:1788791483.704633:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630425728 00000100:00100000:2.0:1788791483.704674:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788791483.704682:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630425728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791483.704737:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630425728:12345-0@lo:400:kworker.0 Request processed in 56us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791483.704744:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788791483.704789:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba85782300 x1875683630425728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791483.704802:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630425728:0@lo:400:kworker.0 00000100:00100000:1.0:1788791483.706410:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630425856 00000100:00100000:1.0:1788791483.706421:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630425856 00000100:00080000:3.0:1788791483.706594:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788791483.706600:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788791483.707476:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788791483.707490:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630425856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791483.707581:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630425856:12345-0@lo:400:kworker.0 Request processed in 96us (3234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791483.707589:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788791483.722942:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630425856:0@lo:400:kworker.0 00010000:00010000:3.0:1788791484.067360:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791484.195762:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba86278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630425984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791484.195832:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791484.196152:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630425984 00000100:00100000:2.0:1788791484.196160:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630425984 00000100:00100000:2.0:1788791484.196213:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788791484.196223:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630425984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788791484.196257:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791484.196551:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb703b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630425984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 328us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791484.196558:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788791484.196650:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba86278380 x1875683630425984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791484.196669:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba86278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630425984:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788791485.091662:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791486.118502:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791486.509675:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791486.509737:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791486.509798:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606275072 00000100:00100000:3.0:1788791486.509808:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606275072 00000100:00100000:3.0:1788791486.509886:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:3.0:1788791486.509897:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606275072:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791486.509970:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606275072:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 74us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791486.509978:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:2.0:1788791486.510282:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606274944 00000100:00100000:2.0:1788791486.510287:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606274944 00000100:00100000:2.0:1788791486.510321:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 208 00000100:00100000:2.0:1788791486.510329:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2355:x1875683606274944:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791486.510365:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2355:x1875683606274944:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 37us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791486.510372:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 208 00000100:00080000:1.0:1788791486.510672:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788791487.142249:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791488.163513:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791488.803553:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630426368:0@lo:400:kworker.0 00000100:00100000:1.0:1788791488.803616:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791488.803663:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788791488.803669:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630426496:0@lo:400:kworker.0 00000100:00100000:1.0:1788791488.803690:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791488.803784:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630426112:0@lo:400:kworker.0 00000100:00100000:3.0:1788791488.803830:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791488.803864:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630426624:0@lo:400:kworker.0 00000100:00100000:3.0:1788791488.803894:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791488.803914:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788791488.803920:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630426240:0@lo:400:kworker.0 00000100:00100000:3.0:1788791488.803938:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791488.803955:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630426752:0@lo:400:kworker.0 00000100:00100000:3.0:1788791488.803974:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791488.804004:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630426368 00000100:00100000:3.0:1788791488.804011:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630426368 00000100:00100000:3.0:1788791488.804060:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630426624 00000100:00100000:3.0:1788791488.804063:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630426624 00000100:00100000:3.0:1788791488.804075:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630426240 00000100:00100000:3.0:1788791488.804077:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630426240 00000100:00100000:3.0:1788791488.804090:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788791488.804098:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630426368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791488.804243:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630426368:12345-0@lo:400:kworker.0 Request processed in 144us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791488.804250:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788791488.804267:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788791488.804273:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630426624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791488.804307:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630426624:12345-0@lo:400:kworker.0 Request processed in 35us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791488.804313:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788791488.804324:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788791488.804329:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8627ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630426240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791488.804355:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8627ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630426240:12345-0@lo:400:kworker.0 Request processed in 25us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791488.804361:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788791488.804410:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630426240:0@lo:400:kworker.0 00000100:00100000:3.0:1788791488.804420:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630426624:0@lo:400:kworker.0 00000100:00100000:1.0:1788791488.804499:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630426112 00000100:00100000:1.0:1788791488.804503:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630426112 00000100:00100000:1.0:1788791488.804542:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788791488.804555:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630426112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791488.804592:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630426112:12345-0@lo:400:kworker.0 Request processed in 38us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791488.804597:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00080000:1.0:1788791488.804627:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791488.804647:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630426368:0@lo:400:kworker.0 00000100:00100000:1.0:1788791488.804667:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630426112:0@lo:400:kworker.0 00000100:00100000:2.0:1788791488.812526:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630426496 00000100:00100000:2.0:1788791488.812542:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630426496 00000100:00100000:2.0:1788791488.812611:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630426752 00000100:00100000:2.0:1788791488.812614:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630426752 00000100:00100000:2.0:1788791488.812632:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788791488.812654:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630426496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791488.823836:0:6681:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788791488.823858:0:6681:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788791488.823882:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788791488.823899:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788791488.823915:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8627b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630426752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791488.824015:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8627b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630426752:12345-0@lo:400:kworker.0 Request processed in 105us (20039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791488.824022:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788791488.824169:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba99364a80 x1875683630426752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791488.824183:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630426752:0@lo:400:kworker.0 00000100:00080000:3.0:1788791488.824309:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788791488.824313:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791488.841922:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630426496:12345-0@lo:400:kworker.0 Request processed in 29259us (38219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791488.841936:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788791488.842082:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8627b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630426880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791488.842180:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791488.842271:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630426880 00000100:00100000:0.0:1788791488.842280:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630426880 00000100:00100000:0.0:1788791488.842323:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788791488.842346:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630426880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788791488.842402:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1788791488.854476:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba99367800 x1875683630426496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791488.854496:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630426496:0@lo:400:kworker.0 00000100:00100000:0.0:1788791488.861701:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630426880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 19345us (19509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791488.861717:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788791488.864398:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba8627b480 x1875683630426880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791504 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791488.864425:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8627b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630426880:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788791489.188241:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791489.316484:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788791489.316510:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba86279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630427008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788791489.316587:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791489.317359:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630427008 00000100:00100000:3.0:1788791489.317371:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630427008 00000100:00100000:3.0:1788791489.317431:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788791489.317441:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630427008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788791489.317478:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791489.317546:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630427008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791489.317553:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788791489.317781:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba86279c00 x1875683630427008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791489.317812:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba86279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630427008:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788791490.212322:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788791491.124736:0:10124:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 10:31:28 (1788791488) === 00010000:00010000:2.0:1788791491.246454:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791491.632604:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791491.632703:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606275200 00000100:00100000:3.0:1788791491.632714:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606275200 00000100:00100000:3.0:1788791491.632776:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 210 00000100:00100000:3.0:1788791491.632786:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:8131:x1875683606275200:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788791491.632818:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791491.632840:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16ca00/0xcd6380150a322d52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453674ed4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791491.632871:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16ca00/0xcd6380150a322d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ed4 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791491.632883:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16ca00/0xcd6380150a322d52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ed4 expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791491.632893:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16ca00, rc 0) 00000100:00100000:3.0:1788791491.632957:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:8131:x1875683606275200:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 172us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791491.632964:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 210 00000100:00100000:2.0:1788791491.638255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791491.640945:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606275328 00000100:00100000:3.0:1788791491.640962:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606275328 00000100:00100000:3.0:1788791491.641070:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:3.0:1788791491.641081:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2352:x1875683606275328:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791491.641210:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2352:x1875683606275328:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 130us (2964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791491.641218:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00080000:1.0:1788791491.641392:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791491.657165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791491.657262:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606275456 00000100:00100000:3.0:1788791491.657273:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606275456 00000100:00100000:3.0:1788791491.657340:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 211 00000100:00100000:3.0:1788791491.657350:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:8131:x1875683606275456:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788791491.657647:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:8131:x1875683606275456:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 297us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791491.657662:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 211 00000100:00100000:2.0:1788791491.662103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791491.662422:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606275584 00000100:00100000:1.0:1788791491.662431:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606275584 00000100:00100000:1.0:1788791491.662782:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 212 00000100:00100000:1.0:1788791491.662795:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:8131:x1875683606275584:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788791491.663025:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:8131:x1875683606275584:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 232us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791491.663033:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 212 00000100:00100000:2.0:1788791491.665264:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791491.665432:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606275712 00000100:00100000:3.0:1788791491.665442:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606275712 00000100:00100000:3.0:1788791491.665739:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 213 00000100:00100000:3.0:1788791491.665760:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:8135:x1875683606275712:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788791491.666025:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:8135:x1875683606275712:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 267us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791491.666033:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 213 00000100:00100000:2.0:1788791491.681862:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791491.681957:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606275840 00000100:00100000:1.0:1788791491.681968:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606275840 00000100:00100000:1.0:1788791491.682021:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 214 00000100:00100000:1.0:1788791491.682031:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:8135:x1875683606275840:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788791491.682460:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:8135:x1875683606275840:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 429us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791491.682469:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 214 00000100:00100000:2.0:1788791491.696338:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791491.697490:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606275968 00000100:00100000:3.0:1788791491.697503:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606275968 00000100:00100000:3.0:1788791491.697564:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 215 00000100:00100000:3.0:1788791491.697574:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:8131:x1875683606275968:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788791491.697590:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791491.697607:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16dc00/0xcd6380150a322d59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453674efe expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791491.697636:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16dc00/0xcd6380150a322d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674efe expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791491.697647:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16dc00/0xcd6380150a322d59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674efe expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791491.697657:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16dc00, rc 0) 00000100:00100000:3.0:1788791491.697727:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:8131:x1875683606275968:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 154us (1398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791491.697734:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 215 00000100:00100000:2.0:1788791491.716496:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791491.716787:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606276096 00000100:00100000:1.0:1788791491.716813:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606276096 00000100:00100000:1.0:1788791491.716911:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 216 00000100:00100000:1.0:1788791491.716922:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:8131:x1875683606276096:12345-192.168.201.29@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788791491.716946:0:5832:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788791491.716964:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788791491.716968:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788791491.716972:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788791491.716974:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788791491.721852:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:8131:x1875683606276096:12345-192.168.201.29@tcp:256:mount.lustre.0 Request processed in 4921us (5355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791491.721868:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 216 00000100:00100000:2.0:1788791491.729198:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791491.729298:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606276224 00000100:00100000:0.0:1788791491.729729:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606276224 00000100:00100000:0.0:1788791491.729840:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 217 00000100:00100000:0.0:1788791491.729851:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:8131:x1875683606276224:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788791491.729867:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791491.729887:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994fe400/0xcd6380150a322d60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f05 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791491.729914:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994fe400/0xcd6380150a322d60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f05 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791491.729925:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994fe400/0xcd6380150a322d60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f05 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791491.729935:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe400, rc 0) 00000100:00100000:0.0:1788791491.729995:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:8131:x1875683606276224:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 146us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791491.730002:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 217 00000100:00100000:2.0:1788791491.733047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791491.733240:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606276352 00000100:00100000:1.0:1788791491.733251:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606276352 00000100:00100000:1.0:1788791491.733480:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 218 00000100:00100000:1.0:1788791491.733886:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:8131:x1875683606276352:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788791491.734226:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:8131:x1875683606276352:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 725us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791491.734234:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 218 00000100:00100000:2.0:1788791491.736852:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791491.736925:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606276480 00000100:00100000:0.0:1788791491.736934:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606276480 00000100:00100000:0.0:1788791491.736980:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 219 00000100:00100000:0.0:1788791491.736990:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:8131:x1875683606276480:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788791491.737216:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:8131:x1875683606276480:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 226us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791491.737224:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 219 00000100:00100000:2.0:1788791491.740759:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791491.741158:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606276608 00000100:00100000:0.0:1788791491.741168:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606276608 00000100:00100000:0.0:1788791491.741227:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 220 00000100:00100000:0.0:1788791491.741238:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:8139:x1875683606276608:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788791491.741513:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:8139:x1875683606276608:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 277us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791491.741521:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 220 00000100:00100000:2.0:1788791491.744714:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791491.744946:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606276736 00000100:00100000:1.0:1788791491.744957:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606276736 00000100:00100000:1.0:1788791491.745015:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 221 00000100:00100000:1.0:1788791491.745039:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:8139:x1875683606276736:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788791491.745318:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:8139:x1875683606276736:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 280us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791491.745326:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 221 00000100:00100000:2.0:1788791491.757235:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791491.757942:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606276864 00000100:00100000:1.0:1788791491.757966:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606276864 00000100:00100000:1.0:1788791491.758020:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:1.0:1788791491.758029:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8625ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2351:x1875683606276864:12345-192.168.201.29@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788791491.758072:0:8351:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 28665881-f918-4421-b36a-72ee58aec27e@192.168.201.29@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:1.0:1788791491.758110:0:8351:0:(genops.c:1385:class_connect()) connect: client 28665881-f918-4421-b36a-72ee58aec27e, cookie 0xcd6380150a322d67 00000004:00100000:1.0:1788791491.758164:0:8351:0:(mdt_handler.c:7331:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788791491.758899:0:8351:0:(import.c:65:import_set_state_nolock()) ffff9aba851e2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788791491.759026:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8625ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28665881-f918-4421-b36a-72ee58aec27e+6:2351:x1875683606276864:12345-192.168.201.29@tcp:38:mount.lustre.0 Request processed in 996us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791491.759035:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1788791491.765357:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791491.765418:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791491.765510:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606277120 00000100:00100000:0.0:1788791491.765520:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606277120 00000100:00100000:0.0:1788791491.765598:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606276992 00000100:00100000:0.0:1788791491.765603:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606276992 00000100:00100000:0.0:1788791491.765628:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:0.0:1788791491.765636:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28665881-f918-4421-b36a-72ee58aec27e+7:8131:x1875683606277120:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788791491.765676:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788791491.765771:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28665881-f918-4421-b36a-72ee58aec27e+7:8131:x1875683606277120:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 135us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791491.765779:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:0.0:1788791491.765796:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:0.0:1788791491.765804:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28665881-f918-4421-b36a-72ee58aec27e+6:0:x1875683606276992:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788791491.765816:0:5836:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788791491.765838:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28665881-f918-4421-b36a-72ee58aec27e+6:0:x1875683606276992:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 35us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791491.765854:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00080000:1.0:1788791491.766735:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791491.772405:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791491.772785:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606277248 00000100:00100000:0.0:1788791491.772796:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606277248 00000100:00100000:0.0:1788791491.772856:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1788791491.772867:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28665881-f918-4421-b36a-72ee58aec27e+6:8131:x1875683606277248:12345-192.168.201.29@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788791491.773039:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28665881-f918-4421-b36a-72ee58aec27e+6:8131:x1875683606277248:12345-192.168.201.29@tcp:40:mount.lustre.0 Request processed in 172us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791491.773046:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1788791491.781237:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791491.781277:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791491.781341:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791491.781849:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606277376 00000100:00100000:1.0:1788791491.781860:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606277376 00000100:00100000:1.0:1788791491.781900:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606277504 00000100:00100000:1.0:1788791491.781903:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606277504 00000100:00100000:1.0:1788791491.781921:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1788791491.781929:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1875683606277376:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788791491.781958:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 28665881-f918-4421-b36a-72ee58aec27e@192.168.201.29@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:1.0:1788791491.781988:0:6681:0:(genops.c:1385:class_connect()) connect: client 28665881-f918-4421-b36a-72ee58aec27e, cookie 0xcd6380150a322d6e 00002000:00100000:1.0:1788791491.781999:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 28665881-f918-4421-b36a-72ee58aec27e/ffff9aba851e0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788791491.782024:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788791491.782247:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788791491.782273:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9aba851e7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788791491.782340:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28665881-f918-4421-b36a-72ee58aec27e+6:2351:x1875683606277376:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 409us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791491.782348:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1788791491.782376:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:1.0:1788791491.782380:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1875683606277504:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788791491.782394:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 28665881-f918-4421-b36a-72ee58aec27e@192.168.201.29@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:1.0:1788791491.782408:0:6681:0:(genops.c:1385:class_connect()) connect: client 28665881-f918-4421-b36a-72ee58aec27e, cookie 0xcd6380150a322d75 00002000:00100000:1.0:1788791491.782413:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 28665881-f918-4421-b36a-72ee58aec27e/ffff9aba851e2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788791491.782426:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788791491.782530:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788791491.782543:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9aba851e4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788791491.782564:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb703800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28665881-f918-4421-b36a-72ee58aec27e+6:2351:x1875683606277504:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 182us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791491.782570:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:2.0:1788791491.783348:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606277632 00000100:00100000:2.0:1788791491.783355:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606277632 00000100:00100000:2.0:1788791491.783391:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:2.0:1788791491.783398:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28665881-f918-4421-b36a-72ee58aec27e+6:8131:x1875683606277632:12345-192.168.201.29@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788791491.783633:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1788791491.783734:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:28665881-f918-4421-b36a-72ee58aec27e+6:8131:x1875683606277632:12345-192.168.201.29@tcp:33:mount.lustre.0 Request processed in 335us (2455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791491.783754:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00010000:00010000:1.0:1788791492.259965:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791493.294813:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791493.927083:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630427136:0@lo:400:kworker.0 00000100:00100000:0.0:1788791493.927182:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791493.927232:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630427648:0@lo:400:kworker.0 00000100:00100000:0.0:1788791493.927262:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791493.927301:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788791493.927308:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630427264:0@lo:400:kworker.0 00000100:00100000:0.0:1788791493.927332:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791493.927351:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630427776:0@lo:400:kworker.0 00000100:00100000:0.0:1788791493.927376:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791493.927405:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630427392:0@lo:400:kworker.0 00000100:00100000:0.0:1788791493.927429:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791493.927447:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788791493.927461:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630427520:0@lo:400:kworker.0 00000100:00100000:0.0:1788791493.927491:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791493.927726:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630427136 00000100:00100000:0.0:1788791493.927733:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630427136 00000100:00100000:0.0:1788791493.927783:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788791493.927793:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630427136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791493.927845:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630427136:12345-0@lo:400:kworker.0 Request processed in 54us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791493.927853:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788791493.927884:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630427648 00000100:00100000:0.0:1788791493.927888:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630427648 00000100:00100000:0.0:1788791493.927921:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630427264 00000100:00100000:0.0:1788791493.927925:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630427264 00000100:00100000:0.0:1788791493.927937:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630427392 00000100:00100000:0.0:1788791493.927939:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630427392 00000100:00100000:0.0:1788791493.927952:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788791493.927958:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630427648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791493.927989:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630427648:12345-0@lo:400:kworker.0 Request processed in 32us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791493.927995:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788791493.928008:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788791493.928014:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630427264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791493.928042:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630427264:12345-0@lo:400:kworker.0 Request processed in 29us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791493.928048:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788791493.928059:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788791493.928065:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630427392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791493.928107:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630427392:12345-0@lo:400:kworker.0 Request processed in 43us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791493.928114:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788791493.928228:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630427776 00000100:00100000:0.0:1788791493.928232:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630427776 00000100:00100000:0.0:1788791493.928260:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630427520 00000100:00100000:0.0:1788791493.928263:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630427520 00000100:00100000:0.0:1788791493.928353:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788791493.928361:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630427776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791493.928396:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630427776:12345-0@lo:400:kworker.0 Request processed in 36us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791493.928402:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788791493.928413:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788791493.928419:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630427520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791493.928443:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630427520:12345-0@lo:400:kworker.0 Request processed in 26us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791493.928449:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788791493.928494:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630427264:0@lo:400:kworker.0 00010000:00080000:0.0:1788791493.928578:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb911500 x1875683630427776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791493.928590:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630427776:0@lo:400:kworker.0 00000100:00100000:0.0:1788791493.928600:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb700700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630427136:0@lo:400:kworker.0 00000100:00100000:0.0:1788791493.928610:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630427648:0@lo:400:kworker.0 00000100:00080000:0.0:1788791493.928638:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788791493.928648:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788791493.928650:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788791493.928671:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299d500 x1875683630427520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791493.928680:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630427520:0@lo:400:kworker.0 00000100:00100000:0.0:1788791493.928690:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630427392:0@lo:400:kworker.0 00000100:00100000:0.0:1788791493.928871:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630427904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791493.928901:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791493.934856:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630427904 00000100:00100000:1.0:1788791493.934872:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630427904 00000100:00100000:1.0:1788791493.934927:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788791493.934939:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630427904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788791493.934975:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791493.935064:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630427904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (6161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791493.935071:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788791493.941998:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba99364e00 x1875683630427904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791509 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791493.944802:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630427904:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788791494.025911:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28665881-f918-4421-b36a-72ee58aec27e 00010000:00010000:1.0:1788791494.308607:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791494.436405:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99367100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630428032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791494.436479:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791494.436556:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630428032 00000100:00100000:1.0:1788791494.436564:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630428032 00000100:00100000:1.0:1788791494.436765:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788791494.436783:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630428032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788791494.436818:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791494.436862:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630428032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791494.436868:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788791494.436911:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba99367100 x1875683630428032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791494.436928:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99367100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630428032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788791495.334335:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788791495.545689:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 28665881-f918-4421-b36a-72ee58aec27e 00000001:00100000:1.0:1788791495.998300:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28665881-f918-4421-b36a-72ee58aec27e 00010000:00010000:1.0:1788791496.355902:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791497.268637:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791497.268688:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791497.268720:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791497.268747:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791497.268773:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791497.268818:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606278272 00000100:00100000:2.0:1788791497.268827:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606278272 00000100:00100000:2.0:1788791497.268889:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606278144 00000100:00100000:2.0:1788791497.268893:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606278144 00000100:00100000:2.0:1788791497.268915:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:2.0:1788791497.268925:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606278272:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791497.269015:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606278272:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 91us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791497.269022:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:2.0:1788791497.269038:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:2.0:1788791497.269045:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606278144:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791497.269069:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606278144:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 24us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791497.269074:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:2.0:1788791497.269091:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606278016 00000100:00100000:2.0:1788791497.269094:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606278016 00000100:00100000:2.0:1788791497.269118:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606277888 00000100:00100000:2.0:1788791497.269121:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606277888 00000100:00100000:2.0:1788791497.269166:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:2.0:1788791497.269172:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606278016:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791497.269200:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606278016:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 28us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791497.269207:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:2.0:1788791497.269219:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:2.0:1788791497.269225:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606277888:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791497.269248:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606277888:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 24us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791497.269263:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00080000:2.0:1788791497.269283:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788791497.269287:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788791497.269289:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788791497.274495:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606277760 00000100:00100000:3.0:1788791497.274510:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606277760 00000100:00100000:3.0:1788791497.274688:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 223 00000100:00100000:3.0:1788791497.274700:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2355:x1875683606277760:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791497.274840:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2355:x1875683606277760:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 142us (6212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791497.274848:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 223 00010000:00010000:0.0:1788791497.381175:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788791497.990437:0:10319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788791498.403976:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791499.043804:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630428160:0@lo:400:kworker.0 00000100:00100000:0.0:1788791499.043874:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791499.043918:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630428672:0@lo:400:kworker.0 00000100:00100000:0.0:1788791499.043944:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791499.043971:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788791499.043977:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630428288:0@lo:400:kworker.0 00000100:00100000:0.0:1788791499.043998:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791499.044014:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630428800:0@lo:400:kworker.0 00000100:00100000:0.0:1788791499.044034:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791499.044062:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630428544:0@lo:400:kworker.0 00000100:00100000:0.0:1788791499.044101:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791499.044121:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788791499.044149:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630428416:0@lo:400:kworker.0 00000100:00100000:0.0:1788791499.044172:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791499.044202:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630428160 00000100:00100000:0.0:1788791499.044209:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630428160 00000100:00100000:0.0:1788791499.044329:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788791499.044339:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630428160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791499.044389:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630428160:12345-0@lo:400:kworker.0 Request processed in 51us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791499.044397:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788791499.044429:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630428672 00000100:00100000:0.0:1788791499.044433:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630428672 00000100:00100000:0.0:1788791499.044467:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630428288 00000100:00100000:0.0:1788791499.044470:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630428288 00000100:00100000:0.0:1788791499.044560:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630428416 00000100:00100000:0.0:1788791499.044564:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630428416 00000100:00100000:0.0:1788791499.044585:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788791499.044591:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630428672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791499.044635:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630428672:12345-0@lo:400:kworker.0 Request processed in 44us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791499.044642:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788791499.044653:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788791499.044658:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630428288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791499.044683:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630428288:12345-0@lo:400:kworker.0 Request processed in 25us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791499.044689:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788791499.044708:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788791499.044714:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630428416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791499.044748:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630428416:12345-0@lo:400:kworker.0 Request processed in 34us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791499.044754:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788791499.044774:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630428800 00000100:00100000:0.0:1788791499.044777:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630428800 00000100:00100000:0.0:1788791499.044801:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630428544 00000100:00100000:0.0:1788791499.044805:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630428544 00000100:00100000:0.0:1788791499.044823:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788791499.044829:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630428800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791499.044858:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630428800:12345-0@lo:400:kworker.0 Request processed in 30us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791499.044864:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788791499.044873:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788791499.044879:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630428544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791499.044900:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630428544:12345-0@lo:400:kworker.0 Request processed in 22us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791499.044905:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788791499.044927:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788791499.044931:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788791499.044933:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791499.044968:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630428416:0@lo:400:kworker.0 00010000:00080000:0.0:1788791499.044980:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb913480 x1875683630428544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791499.044991:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630428544:0@lo:400:kworker.0 00000100:00100000:0.0:1788791499.045034:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630428288:0@lo:400:kworker.0 00010000:00080000:0.0:1788791499.045043:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb912680 x1875683630428800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791499.045049:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630428800:0@lo:400:kworker.0 00000100:00100000:0.0:1788791499.045056:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630428160:0@lo:400:kworker.0 00000100:00100000:0.0:1788791499.045064:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630428672:0@lo:400:kworker.0 00000100:00100000:0.0:1788791499.045980:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788791499.045994:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8627a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630428928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791499.046034:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791499.048762:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630428928 00000100:00100000:1.0:1788791499.048774:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630428928 00000100:00100000:1.0:1788791499.048834:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788791499.048844:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630428928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788791499.048880:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1788791499.049320:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba8627a680 x1875683630428928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791499.049342:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8627a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630428928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791499.049402:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630428928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 559us (3366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791499.049410:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788791499.427379:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791499.555322:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788791499.555347:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99367100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630429056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791499.555418:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791499.556075:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630429056 00000100:00100000:3.0:1788791499.556085:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630429056 00000100:00100000:3.0:1788791499.556168:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788791499.556178:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630429056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788791499.556212:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791499.556265:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630429056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791499.556271:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788791499.556354:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba99367100 x1875683630429056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791499.556373:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99367100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630429056:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788791500.451316:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791501.478361:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791502.385008:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791502.385103:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791502.385221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791502.385247:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791502.385308:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606278656 00000100:00100000:1.0:1788791502.385320:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606278656 00000100:00100000:2.0:1788791502.385329:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791502.385356:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606278912 00000100:00100000:2.0:1788791502.385360:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606278912 00000100:00100000:2.0:1788791502.385401:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606278784 00000100:00100000:1.0:1788791502.385403:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606278528 00000100:00100000:2.0:1788791502.385404:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606278784 00000100:00100000:1.0:1788791502.385424:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606278528 00000100:00100000:2.0:1788791502.385429:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:2.0:1788791502.385447:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28665881-f918-4421-b36a-72ee58aec27e+5:2354:x1875683606278912:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791502.385463:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00100000:1.0:1788791502.385473:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28665881-f918-4421-b36a-72ee58aec27e+5:2354:x1875683606278656:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791502.385522:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28665881-f918-4421-b36a-72ee58aec27e+5:2354:x1875683606278912:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 78us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791502.385529:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:2.0:1788791502.385545:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:2.0:1788791502.385552:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28665881-f918-4421-b36a-72ee58aec27e+5:2354:x1875683606278784:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791502.385579:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:0.0:1788791502.385592:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2354:x1875683606278528:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791502.385889:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28665881-f918-4421-b36a-72ee58aec27e+5:2354:x1875683606278656:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 416us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791502.385897:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00100000:2.0:1788791502.386567:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:28665881-f918-4421-b36a-72ee58aec27e+5:2354:x1875683606278784:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 1003us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791502.386577:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00080000:2.0:1788791502.386749:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788791502.386762:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788791502.386766:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791502.388422:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606278400 00000100:00100000:3.0:1788791502.389080:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606278400 00000100:00100000:0.0:1788791502.389506:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2354:x1875683606278528:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 3910us (4251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791502.389520:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:2.0:1788791502.395405:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 225 00000100:00100000:2.0:1788791502.395419:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2354:x1875683606278400:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791502.396406:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2354:x1875683606278400:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 983us (11529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791502.396417:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 225 00010000:00010000:2.0:1788791502.499453:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791503.523714:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791504.163392:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8627a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630429184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791504.163476:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791504.163572:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630429184 00000100:00100000:0.0:1788791504.163580:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630429184 00000100:00100000:0.0:1788791504.163633:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788791504.163644:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630429184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788791504.163685:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791504.163742:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630429184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791504.163749:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788791504.163767:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788791504.163798:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba8627a680 x1875683630429184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791504.163816:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8627a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630429184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791504.163910:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630429440:0@lo:400:kworker.0 00000100:00100000:0.0:1788791504.163939:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791504.163960:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788791504.163965:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630429568:0@lo:400:kworker.0 00000100:00100000:0.0:1788791504.163985:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791504.164009:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630429440 00000100:00100000:0.0:1788791504.164013:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630429440 00000100:00100000:0.0:1788791504.164037:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630429568 00000100:00100000:0.0:1788791504.164039:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630429568 00000100:00100000:0.0:1788791504.164058:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788791504.164064:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630429440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791504.164094:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630429440:12345-0@lo:400:kworker.0 Request processed in 31us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791504.164100:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788791504.164111:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788791504.164117:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630429568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791504.164162:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630429568:12345-0@lo:400:kworker.0 Request processed in 45us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791504.164167:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788791504.164200:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630429312:0@lo:400:kworker.0 00000100:00100000:0.0:1788791504.164228:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791504.164247:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630429824:0@lo:400:kworker.0 00000100:00100000:0.0:1788791504.164263:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791504.164276:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788791504.164280:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630429696:0@lo:400:kworker.0 00000100:00100000:0.0:1788791504.164298:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791504.164317:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630429312 00000100:00100000:0.0:1788791504.164320:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630429312 00000100:00100000:0.0:1788791504.164342:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788791504.164347:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3315:x1875683630429312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791504.164374:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3315:x1875683630429312:12345-0@lo:400:kworker.0 Request processed in 27us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791504.164380:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788791504.164403:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630429696 00000100:00100000:0.0:1788791504.164406:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630429696 00000100:00100000:0.0:1788791504.164432:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788791504.164439:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630429696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791504.164466:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630429696:12345-0@lo:400:kworker.0 Request processed in 28us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791504.164472:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788791504.164490:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788791504.164493:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791504.164512:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630429568:0@lo:400:kworker.0 00000100:00100000:0.0:1788791504.164521:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630429440:0@lo:400:kworker.0 00010000:00080000:0.0:1788791504.164559:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb913100 x1875683630429696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791504.164575:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630429696:0@lo:400:kworker.0 00000100:00100000:0.0:1788791504.164584:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630429312:0@lo:400:kworker.0 00000100:00100000:0.0:1788791504.164603:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630429824 00000100:00100000:0.0:1788791504.164606:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630429824 00000100:00100000:0.0:1788791504.164633:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788791504.164638:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630429824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791504.164670:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630429824:12345-0@lo:400:kworker.0 Request processed in 31us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791504.164676:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1788791504.164689:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791504.164703:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630429824:0@lo:400:kworker.0 00010000:00010000:2.0:1788791504.550105:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791504.675758:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630429952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788791504.675941:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791504.675991:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630429952 00000100:00100000:0.0:1788791504.675999:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630429952 00000100:00100000:0.0:1788791504.676400:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788791504.676411:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630429952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788791504.676448:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791504.676503:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630429952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791504.676509:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788791504.676562:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba99366680 x1875683630429952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791504.676582:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99366680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630429952:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788791505.577655:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791506.598954:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791507.514165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791507.514211:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606279040 00000100:00100000:1.0:1788791507.514222:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606279040 00000100:00100000:3.0:1788791507.514226:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791507.514255:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791507.514276:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 227 00000100:00100000:3.0:1788791507.514282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791507.514288:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2355:x1875683606279040:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791507.514310:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791507.514334:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606279552 00000100:00100000:3.0:1788791507.514339:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606279552 00000100:00100000:1.0:1788791507.514370:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2355:x1875683606279040:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 85us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791507.514375:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606279424 00000100:00100000:1.0:1788791507.514380:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 227 00000100:00100000:3.0:1788791507.514381:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606279424 00000100:00100000:3.0:1788791507.514410:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:3.0:1788791507.514419:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606279552:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791507.514453:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606279552:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 36us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791507.514460:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:3.0:1788791507.514487:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:3.0:1788791507.514495:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606279424:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791507.514524:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86278000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606279424:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 29us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791507.514530:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:0.0:1788791507.514677:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606279296 00000100:00100000:0.0:1788791507.514682:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606279296 00000100:00100000:0.0:1788791507.514712:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606279168 00000100:00100000:0.0:1788791507.514715:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606279168 00000100:00100000:0.0:1788791507.514738:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:0.0:1788791507.514746:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606279296:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791507.514796:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606279296:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 52us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791507.514803:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:0.0:1788791507.514818:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:0.0:1788791507.514824:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8627bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606279168:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791507.514850:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8627bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606279168:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 26us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791507.514857:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00080000:0.0:1788791507.514881:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788791507.514887:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788791507.514889:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788791507.622754:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791508.644770:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791509.285355:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630430080:0@lo:400:kworker.0 00000100:00100000:1.0:1788791509.285483:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791509.285548:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630430592:0@lo:400:kworker.0 00000100:00100000:1.0:1788791509.285582:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791509.285629:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788791509.285636:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630430464:0@lo:400:kworker.0 00000100:00100000:1.0:1788791509.285665:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791509.285712:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630430464 00000100:00100000:1.0:1788791509.285721:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630430464 00000100:00100000:1.0:1788791509.285806:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788791509.285818:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630430464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791509.285880:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630430464:12345-0@lo:400:kworker.0 Request processed in 63us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791509.285905:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788791509.285960:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba99364000 x1875683630430464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791509.285979:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630430464:0@lo:400:kworker.0 00000100:00100000:1.0:1788791509.286330:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630430336:0@lo:400:kworker.0 00000100:00100000:1.0:1788791509.286365:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791509.286390:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788791509.286397:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630430208:0@lo:400:kworker.0 00000100:00100000:1.0:1788791509.286423:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791509.286458:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630430720:0@lo:400:kworker.0 00000100:00100000:1.0:1788791509.286484:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791509.286551:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791509.286559:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630430848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791509.286588:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791509.288741:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630430848 00000100:00100000:1.0:1788791509.288837:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630430848 00000100:00100000:1.0:1788791509.288931:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788791509.288944:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630430848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788791509.288995:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791509.289219:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630430080 00000100:00100000:0.0:1788791509.289224:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630430080 00000100:00100000:0.0:1788791509.289260:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788791509.289267:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630430080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791509.289359:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630430080:12345-0@lo:400:kworker.0 Request processed in 93us (3878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791509.289367:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788791509.289423:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630430592 00000100:00100000:0.0:1788791509.289429:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630430592 00000100:00100000:0.0:1788791509.289467:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630430336 00000100:00100000:0.0:1788791509.289471:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630430336 00000100:00100000:0.0:1788791509.289485:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630430208 00000100:00100000:0.0:1788791509.289488:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630430208 00000100:00100000:0.0:1788791509.289502:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788791509.289508:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630430592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791509.289553:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630430592:12345-0@lo:400:kworker.0 Request processed in 45us (3970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791509.289559:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788791509.289572:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788791509.289578:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630430336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791509.296353:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630430848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7394us (9745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791509.296376:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788791509.296499:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630430336:0@lo:400:kworker.0 00010000:00080000:1.0:1788791509.296549:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba99364e00 x1875683630430848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791509.296586:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630430848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791509.297813:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630430720 00000100:00100000:1.0:1788791509.297829:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630430720 00000100:00100000:1.0:1788791509.297902:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788791509.297914:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630430720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791509.298168:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630430720:12345-0@lo:400:kworker.0 Request processed in 254us (11681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791509.298176:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788791509.298206:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788791509.298216:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630430208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791509.298253:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630430208:12345-0@lo:400:kworker.0 Request processed in 40us (11829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791509.298259:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:1.0:1788791509.298286:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788791509.298294:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788791509.298297:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788791509.298333:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630430208:0@lo:400:kworker.0 00010000:00080000:1.0:1788791509.298350:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba99366a00 x1875683630430720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791509.298361:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630430720:0@lo:400:kworker.0 00000100:00100000:0.0:1788791509.302924:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99364000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630430336:12345-0@lo:400:kworker.0 Request processed in 13328us (16540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791509.302946:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788791509.305478:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630430080:0@lo:400:kworker.0 00000100:00100000:0.0:1788791509.305512:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630430592:0@lo:400:kworker.0 00010000:00010000:2.0:1788791509.670309:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791509.799087:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630430976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788791509.800590:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791509.800757:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630430976 00000100:00100000:1.0:1788791509.800781:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630430976 00000100:00100000:1.0:1788791509.800853:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788791509.800866:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630430976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788791509.801108:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791509.802374:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630430976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1499us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791509.802389:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788791509.806670:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba99366a00 x1875683630430976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791509.806707:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630430976:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788791510.691377:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791511.725659:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791512.623025:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791512.623067:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791512.623109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791512.623153:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606279680 00000100:00100000:3.0:1788791512.623162:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606279680 00000100:00100000:3.0:1788791512.623217:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 229 00000100:00100000:3.0:1788791512.623227:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2352:x1875683606279680:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791512.623302:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2352:x1875683606279680:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 76us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791512.623310:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 229 00000100:00100000:3.0:1788791512.623342:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606279936 00000100:00100000:3.0:1788791512.623345:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606279936 00000100:00100000:3.0:1788791512.623397:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606279808 00000100:00100000:3.0:1788791512.623401:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606279808 00000100:00100000:3.0:1788791512.623424:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:3.0:1788791512.623431:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8627a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28665881-f918-4421-b36a-72ee58aec27e+5:2352:x1875683606279936:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791512.623460:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:3.0:1788791512.623464:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8627a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28665881-f918-4421-b36a-72ee58aec27e+5:2352:x1875683606279936:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 32us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791512.623517:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8627a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2352:x1875683606279808:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791512.623547:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8627a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2352:x1875683606279808:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 36us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791512.623628:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00080000:3.0:1788791512.623652:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791512.626347:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791512.626400:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791512.626498:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606280064 00000100:00100000:1.0:1788791512.626508:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606280064 00000100:00100000:1.0:1788791512.626572:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606280192 00000100:00100000:1.0:1788791512.626576:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606280192 00000100:00100000:1.0:1788791512.626598:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:1.0:1788791512.626607:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28665881-f918-4421-b36a-72ee58aec27e+5:2351:x1875683606280064:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:1.0:1788791512.626634:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322d6e 00000100:00080000:1.0:1788791512.626644:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9aba851e7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788791512.626697:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788791512.627036:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28665881-f918-4421-b36a-72ee58aec27e+2:2351:x1875683606280064:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 428us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791512.627044:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:1.0:1788791512.627061:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:1.0:1788791512.627068:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28665881-f918-4421-b36a-72ee58aec27e+5:2351:x1875683606280192:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:1.0:1788791512.627081:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322d75 00000100:00080000:1.0:1788791512.627086:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9aba851e4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788791512.627106:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788791512.627317:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:28665881-f918-4421-b36a-72ee58aec27e+2:2351:x1875683606280192:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 248us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791512.627324:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00010000:00010000:1.0:1788791512.627345:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788791512.627860:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788791512.627866:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791512.631388:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 85 00010000:00010000:2.0:1788791512.631446:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791512.745091:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791513.770206:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791514.412650:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630431104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791514.412725:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791514.413241:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630431104 00000100:00100000:2.0:1788791514.413251:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630431104 00000100:00100000:2.0:1788791514.413308:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788791514.413319:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630431104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788791514.413365:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791514.413419:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630431104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791514.413427:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788791514.413448:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788791514.413479:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba99365f80 x1875683630431104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791514.413497:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630431104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791514.416525:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630431616:0@lo:400:kworker.0 00000100:00100000:2.0:1788791514.416594:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791514.416642:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788791514.416650:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630431488:0@lo:400:kworker.0 00000100:00100000:2.0:1788791514.416677:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791514.416708:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630431488 00000100:00100000:2.0:1788791514.416715:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630431488 00000100:00100000:2.0:1788791514.416765:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788791514.416776:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630431488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791514.416828:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630431488:12345-0@lo:400:kworker.0 Request processed in 54us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791514.416835:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1788791514.416867:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791514.416970:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630431488:0@lo:400:kworker.0 00000100:00100000:0.0:1788791514.422975:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630431616 00000100:00100000:0.0:1788791514.422989:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630431616 00000100:00100000:0.0:1788791514.423058:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788791514.423069:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630431616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791514.423175:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630431616:12345-0@lo:400:kworker.0 Request processed in 109us (6580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791514.423183:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788791514.423768:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788791514.425158:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630431232:0@lo:400:kworker.0 00000100:00100000:1.0:1788791514.425223:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791514.425270:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630431744:0@lo:400:kworker.0 00000100:00100000:1.0:1788791514.425297:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791514.425326:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791514.425333:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630431360:0@lo:400:kworker.0 00000100:00100000:1.0:1788791514.425370:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791514.425422:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630431232 00000100:00100000:1.0:1788791514.425428:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630431232 00000100:00100000:1.0:1788791514.425470:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788791514.425479:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630431232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791514.425524:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630431232:12345-0@lo:400:kworker.0 Request processed in 45us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791514.425530:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788791514.425559:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630431744 00000100:00100000:1.0:1788791514.425562:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630431744 00000100:00100000:1.0:1788791514.425593:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630431360 00000100:00100000:1.0:1788791514.425596:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630431360 00000100:00100000:1.0:1788791514.425612:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788791514.425618:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630431744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791514.425646:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630431744:12345-0@lo:400:kworker.0 Request processed in 28us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791514.425652:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788791514.425664:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788791514.425681:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630431360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791514.425708:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630431360:12345-0@lo:400:kworker.0 Request processed in 29us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791514.425714:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788791514.425754:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630431360:0@lo:400:kworker.0 00000100:00100000:1.0:1788791514.425764:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630431232:0@lo:400:kworker.0 00000100:00100000:1.0:1788791514.425773:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630431744:0@lo:400:kworker.0 00000100:00080000:1.0:1788791514.425800:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788791514.426019:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb484380 x1875683630431616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791514.426031:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630431616:0@lo:400:kworker.0 00000001:00100000:2.0:1788791514.514891:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 28665881-f918-4421-b36a-72ee58aec27e 00000020:00000080:2.0:1788791514.514904:0:6705:0:(genops.c:885:class_export_put()) final put ffff9aba851e0800/28665881-f918-4421-b36a-72ee58aec27e 00000020:00000080:3.0:1788791514.514953:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba851e0800/28665881-f918-4421-b36a-72ee58aec27e for lustre-OST0000 00000020:00000080:3.0:1788791514.515003:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9aba851e7000 for lustre-OST0000 00010000:00010000:1.0:1788791514.787395:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791514.915656:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788791514.915681:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630431872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788791514.915749:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791514.915846:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630431872 00000100:00100000:0.0:1788791514.915855:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630431872 00000100:00100000:0.0:1788791514.915905:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788791514.915915:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630431872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788791514.915965:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791514.916032:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630431872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791514.916039:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788791514.916198:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba99364700 x1875683630431872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791530 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791514.916218:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630431872:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788791515.678387:0:11019:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788791515.823411:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788791516.523289:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 28665881-f918-4421-b36a-72ee58aec27e 00000020:00000080:1.0:1788791516.523300:0:7644:0:(genops.c:885:class_export_put()) final put ffff9aba851e2800/28665881-f918-4421-b36a-72ee58aec27e 00000020:00000080:0.0:1788791516.529550:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba851e2800/28665881-f918-4421-b36a-72ee58aec27e for lustre-OST0001 00000020:00000080:0.0:1788791516.532041:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9aba851e4000 for lustre-OST0001 00010000:00010000:0.0:1788791516.836286:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791517.742273:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791517.742323:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791517.742349:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791517.742377:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606280576 00000100:00100000:1.0:1788791517.742387:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606280576 00000100:00100000:1.0:1788791517.742447:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606280448 00000100:00100000:1.0:1788791517.742451:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606280448 00000100:00100000:1.0:1788791517.742475:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 89 00000100:00100000:1.0:1788791517.742486:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28665881-f918-4421-b36a-72ee58aec27e+5:2354:x1875683606280576:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791517.742561:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28665881-f918-4421-b36a-72ee58aec27e+5:2354:x1875683606280576:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 78us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791517.742582:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 89 00000100:00100000:1.0:1788791517.742602:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00100000:1.0:1788791517.742610:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2354:x1875683606280448:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791517.742639:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2354:x1875683606280448:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 31us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791517.742645:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00080000:1.0:1788791517.742666:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791517.745308:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606280320 00000100:00100000:0.0:1788791517.745324:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606280320 00000100:00100000:0.0:1788791517.745388:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 231 00000100:00100000:0.0:1788791517.745399:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2354:x1875683606280320:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791517.745497:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2354:x1875683606280320:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 99us (3235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791517.745505:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 231 00010000:00010000:2.0:1788791517.859431:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791518.889592:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788791519.259438:0:11168:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6fb8e230 20000000:00000080:0.0:1788791519.259453:0:11168:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9abab79edc00 uarg=0000000000000000 20000000:01000000:0.0:1788791519.259485:0:11168:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788791519.259491:0:11168:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788791519.259495:0:11168:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788791519.260295:0:11169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788791519.260719:0:11168:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788791519.267115:0:11168:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788791519.267295:0:11168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9aba994ff200/0xcd6380150a322d7c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791519.267316:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9abaa1b5cc00/0xcd6380150a322d21 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ecd expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791519.267324:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba994ff600/0xcd6380150a322d2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322d28 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791519.267344:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9abac2171400/0xcd6380150a322d3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322d36 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791519.267350:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba994fee00/0xcd6380150a322d4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322d44 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791519.267357:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba994fe400/0xcd6380150a322d60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f05 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791519.267364:0:11168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9aba994ff200/0xcd6380150a322d7c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791519.267403:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba994fe400/0xcd6380150a322d60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f05 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791519.267417:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9aba994fe400/0xcd6380150a322d60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f05 expref: 12 pid: 5830 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791519.267431:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb487100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875683630432000:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788791519.268179:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba994fee00/0xcd6380150a322d4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322d44 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791519.268191:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9aba994fee00/0xcd6380150a322d4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322d44 expref: 18 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791519.268202:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb487480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875683630432128:0@lo:104: 00000100:00100000:0.0:1788791519.268235:0:11168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788791519.268281:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9abac2171400/0xcd6380150a322d3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322d36 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791519.268285:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630432128 00000100:00100000:2.0:1788791519.268292:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630432128 00010000:00010000:0.0:1788791519.268296:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9abac2171400/0xcd6380150a322d3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322d36 expref: 18 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791519.268304:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875683630432256:0@lo:104: 00000100:00100000:0.0:1788791519.268330:0:11168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791519.268386:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630432256 00000100:00100000:2.0:1788791519.268389:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630432256 00010000:00010000:0.0:1788791519.268403:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba994ff600/0xcd6380150a322d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322d28 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791519.268411:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9aba994ff600/0xcd6380150a322d2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322d28 expref: 18 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791519.268420:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb485f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875683630432384:0@lo:104: 00000100:00100000:1.0:1788791519.268431:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788791519.268441:0:11168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791519.268442:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb485c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+4:11168:x1875683630432128:12345-0@lo:104: 00010000:00010000:1.0:1788791519.268453:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9abac2170400/0xcd6380150a322d44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322d4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791519.268457:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9abaa1b5cc00/0xcd6380150a322d21 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ecd expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791519.268477:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9abaa1b5cc00/0xcd6380150a322d21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ecd expref: 12 pid: 5831 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791519.268487:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb484000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875683630432512:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791519.268501:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788791519.268506:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb485c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+4:11168:x1875683630432128:12345-0@lo:104: Request processed in 67us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791519.268513:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788791519.268528:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630432384 00000100:00100000:1.0:1788791519.268531:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630432384 00000100:00100000:1.0:1788791519.268546:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788791519.268552:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb485180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+4:11168:x1875683630432256:12345-0@lo:104: 00010000:00010000:1.0:1788791519.268560:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba80030000/0xcd6380150a322d36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322d3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791519.268586:0:11168:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9924f840 going to sleep for 11 seconds 00010000:00010000:1.0:1788791519.268590:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788791519.268595:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb485180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+4:11168:x1875683630432256:12345-0@lo:104: Request processed in 44us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791519.268606:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788791519.268618:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788791519.268621:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb487480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875683630432128:0@lo:104: 00000100:00100000:1.0:1788791519.268624:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb487b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:11168:x1875683630432384:12345-0@lo:104: 00000100:00100000:0.0:1788791519.268629:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875683630432256:0@lo:104: 00010000:00010000:1.0:1788791519.268631:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9abac2170c00/0xcd6380150a322d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322d2f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791519.268672:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788791519.268677:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb487b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:11168:x1875683630432384:12345-0@lo:104: Request processed in 54us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791519.268683:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788791519.268700:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788791519.268706:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abac2170400/0xcd6380150a322d44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322d4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791519.268761:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abac2170400 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791519.268766:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abac2170400/0xcd6380150a322d44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322d4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791519.268775:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abac2170400/0xcd6380150a322d44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322d4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791519.268782:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abac2170400/0xcd6380150a322d44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322d4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791519.268788:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788791519.268791:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb485f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875683630432384:0@lo:104: 00010000:00010000:1.0:1788791519.268816:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abac2170400/0xcd6380150a322d44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322d4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791519.268824:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791519.268858:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abac2170400/0xcd6380150a322d44 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322d4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791519.268866:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abac2170400/0xcd6380150a322d44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322d4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791519.268879:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788791519.268882:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba80030000/0xcd6380150a322d36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322d3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791519.268888:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba80030000 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791519.268891:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba80030000/0xcd6380150a322d36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322d3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791519.268898:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba80030000/0xcd6380150a322d36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322d3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791519.268903:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba80030000/0xcd6380150a322d36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322d3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791519.268908:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788791519.268908:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630432640:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791519.268921:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba80030000/0xcd6380150a322d36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322d3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791519.268926:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791519.268932:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba80030000/0xcd6380150a322d36 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322d3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791519.268936:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788791519.268938:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba80030000/0xcd6380150a322d36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322d3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791519.268947:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791519.268954:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abac2170c00/0xcd6380150a322d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322d2f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791519.268959:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abac2170c00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791519.268962:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abac2170c00/0xcd6380150a322d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322d2f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791519.268962:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788791519.268967:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630432768:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791519.268969:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abac2170c00/0xcd6380150a322d28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322d2f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791519.268975:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abac2170c00/0xcd6380150a322d28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322d2f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791519.268980:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1788791519.268986:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788791519.269004:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abac2170c00/0xcd6380150a322d28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322d2f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791519.269010:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788791519.269010:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630432640 00000100:00100000:0.0:1788791519.269013:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630432640 00010000:00010000:1.0:1788791519.269024:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abac2170c00/0xcd6380150a322d28 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322d2f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791519.269030:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abac2170c00/0xcd6380150a322d28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322d2f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791519.269032:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba994fee00/0xcd6380150a322d4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322d44 expref: 19 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791519.269043:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791519.269045:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791519.269047:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791519.269049:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630432768 00000100:00100000:0.0:1788791519.269051:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630432768 00010000:00010000:0.0:1788791519.269062:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9abac2171400/0xcd6380150a322d3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322d36 expref: 20 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791519.269063:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630432896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788791519.269079:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788791519.269085:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa001f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+20:3312:x1875683630432640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788791519.269094:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791519.269099:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba994fee00/0xcd6380150a322d4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322d44 expref: 20 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791519.269100:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788791519.269108:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba994fee00/0xcd6380150a322d4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322d44 expref: 20 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791519.269119:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994fee00/0xcd6380150a322d4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322d44 expref: 20 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791519.269122:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630432896 00000100:00100000:1.0:1788791519.269143:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630432896 00010000:00010000:0.0:1788791519.269147:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788791519.269162:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba994ff600/0xcd6380150a322d2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322d28 expref: 20 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791519.269172:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa001f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+20:3312:x1875683630432640:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791519.269176:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788791519.269179:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788791519.269181:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb486300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9967ad2d-016f-4163-8b2b-d5dc380f4403+20:3312:x1875683630432768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791519.269187:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791519.269191:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9abac2171400/0xcd6380150a322d3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322d36 expref: 19 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791519.269198:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9abac2171400/0xcd6380150a322d3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322d36 expref: 19 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791519.269207:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abac2171400/0xcd6380150a322d3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322d36 expref: 19 pid: 5830 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791519.269213:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788791519.269215:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791519.269225:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc00a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:3314:x1875683630432896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788791519.269232:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788791519.269235:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb486300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:3312:x1875683630432768:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (249us total) trans 0 rc 0/0 00010000:00010000:0.0:1788791519.269236:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba994ff600/0xcd6380150a322d2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322d28 expref: 18 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791519.269241:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788791519.269244:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba994ff600/0xcd6380150a322d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322d28 expref: 18 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791519.269254:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994ff600/0xcd6380150a322d2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322d28 expref: 17 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791519.269272:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791519.269306:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc00a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:3314:x1875683630432896:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791519.269312:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788791519.269341:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630432896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788791519.269341:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99366300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630432768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788791519.269348:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630432640:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788791519.269615:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791519.290536:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791519.290625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791519.290814:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606280704 00000100:00100000:3.0:1788791519.290825:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606280704 00010000:00010000:3.0:1788791519.290879:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba994fe400/0xcd6380150a322d60 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f05 expref: 13 pid: 5830 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791519.290938:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606280832 00000100:00100000:3.0:1788791519.290942:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606280832 00010000:00010000:3.0:1788791519.290957:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9abaa1b5cc00/0xcd6380150a322d21 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ecd expref: 14 pid: 5831 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791519.290977:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:3.0:1788791519.290986:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc009180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+14:2355:x1875683606280704:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791519.291000:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791519.291006:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba994fe400/0xcd6380150a322d60 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f05 expref: 14 pid: 5830 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791519.291017:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba994fe400/0xcd6380150a322d60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f05 expref: 14 pid: 5830 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791519.291037:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791519.291092:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc009180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+14:2355:x1875683606280704:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 107us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791519.291100:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:3.0:1788791519.291117:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:3.0:1788791519.291123:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc009f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2354:x1875683606280832:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791519.291161:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791519.291166:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9abaa1b5cc00/0xcd6380150a322d21 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ecd expref: 13 pid: 5831 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791519.291176:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9abaa1b5cc00/0xcd6380150a322d21 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ecd expref: 13 pid: 5831 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791519.291198:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9aba994ff200/0xcd6380150a322d7c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791519.291207:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ff200/0xcd6380150a322d7c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791519.291220:0:8452:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9aba994ff200/0xcd6380150a322d7c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791519.291227:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9aba994ff200/0xcd6380150a322d7c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791519.291235:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9aba994ff200/0xcd6380150a322d7c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791519.291241:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9aba994ff200/0xcd6380150a322d7c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791519.291247:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791519.291252:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9aba994ff200/0xcd6380150a322d7c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791519.291260:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9aba994ff200/0xcd6380150a322d7c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791519.291282:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9aba994ff200/0xcd6380150a322d7c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791519.291292:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791519.291312:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc009f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2354:x1875683606280832:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 189us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791519.291328:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00010000:00010000:2.0:1788791519.294463:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994fe400/0xcd6380150a322d60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f05 expref: 12 pid: 5830 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791519.294488:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb487100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875683630432000:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791519.294502:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abaa1b5cc00/0xcd6380150a322d21 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ecd expref: 11 pid: 5831 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791519.294510:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb484000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1875683630432512:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791519.294568:0:11168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9aba994ff200/0xcd6380150a322d7c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791519.294589:0:11168:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9aba994ff200/0xcd6380150a322d7c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791519.294619:0:11168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9aba994ff200/0xcd6380150a322d7c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791519.294625:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994ff200/0xcd6380150a322d7c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791519.532860:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc00bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630433024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791519.532930:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791519.533669:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630433024 00000100:00100000:0.0:1788791519.533678:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630433024 00000100:00100000:0.0:1788791519.533741:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788791519.533753:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630433024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788791519.533790:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791519.533914:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630433024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791519.533921:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788791519.533959:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788791519.533991:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababc00bb80 x1875683630433024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791535 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791519.534019:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc00bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630433024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791519.536780:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788791519.536798:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8627b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630433152:0@lo:400:kworker.0 00000100:00100000:3.0:1788791519.536866:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791519.536909:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630433152 00000100:00100000:3.0:1788791519.536916:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630433152 00000100:00100000:3.0:1788791519.536959:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788791519.536967:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630433152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791519.537016:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630433152:12345-0@lo:400:kworker.0 Request processed in 50us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791519.537023:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788791519.537063:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8627b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630433152:0@lo:400:kworker.0 00000100:00100000:3.0:1788791519.537097:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8627b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630433280:0@lo:400:kworker.0 00000100:00100000:3.0:1788791519.537120:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791519.537173:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630433280 00000100:00100000:3.0:1788791519.537178:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630433280 00000100:00100000:3.0:1788791519.537209:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788791519.537215:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8627aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630433280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791519.537249:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8627aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630433280:12345-0@lo:400:kworker.0 Request processed in 35us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791519.537256:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788791519.537296:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8627b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630433280:0@lo:400:kworker.0 00000100:00100000:3.0:1788791519.537331:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8627b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630433408:0@lo:400:kworker.0 00000100:00100000:3.0:1788791519.537359:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791519.537401:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630433408 00000100:00100000:3.0:1788791519.537404:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630433408 00000100:00100000:3.0:1788791519.537430:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788791519.537436:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630433408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791519.537472:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630433408:12345-0@lo:400:kworker.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791519.537477:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788791519.537631:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba8627b480 x1875683630433408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791519.537642:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8627b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630433408:0@lo:400:kworker.0 00000100:00100000:3.0:1788791519.537671:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788791519.537677:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8627b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630433536:0@lo:400:kworker.0 00000100:00100000:3.0:1788791519.537700:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791519.537722:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630433536 00000100:00100000:3.0:1788791519.537725:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630433536 00000100:00100000:3.0:1788791519.537750:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788791519.537757:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630433536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791519.537788:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630433536:12345-0@lo:400:kworker.0 Request processed in 31us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791519.537794:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788791519.537818:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8627b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630433536:0@lo:400:kworker.0 00000100:00080000:0.0:1788791519.538496:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788791519.538503:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788791519.908102:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791520.035377:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788791520.035404:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc00a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630433664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788791520.035480:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791520.035710:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630433664 00000100:00100000:0.0:1788791520.035720:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630433664 00000100:00100000:0.0:1788791520.035778:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788791520.035790:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8627b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630433664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788791520.035828:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791520.035881:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8627b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630433664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791520.035888:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788791520.036036:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababc00a300 x1875683630433664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791520.036075:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc00a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630433664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788791520.368709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791520.368913:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606280960 00000100:00100000:1.0:1788791520.368924:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606280960 00000100:00100000:1.0:1788791520.368983:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 232 00000100:00100000:1.0:1788791520.368994:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:5597:x1875683606280960:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788791520.369018:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791520.369038:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322d83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f2f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791520.369066:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f2f expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791520.369078:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f2f expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791520.369087:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abaa1b5c800, rc 0) 00000100:00100000:1.0:1788791520.369201:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:5597:x1875683606280960:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 209us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791520.369209:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 232 00000100:00100000:0.0:1788791520.373853:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791520.373953:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606281088 00000100:00100000:1.0:1788791520.373963:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606281088 00000100:00100000:1.0:1788791520.374020:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 233 00000100:00100000:1.0:1788791520.374031:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:5597:x1875683606281088:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791520.374349:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:5597:x1875683606281088:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 318us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791520.374358:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 233 00000100:00100000:2.0:1788791520.380386:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791520.382996:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606281216 00000100:00100000:3.0:1788791520.383012:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606281216 00000100:00100000:3.0:1788791520.383172:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 234 00000100:00100000:3.0:1788791520.383184:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:5597:x1875683606281216:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788791520.383440:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:5597:x1875683606281216:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 257us (3064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791520.383449:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 234 00000100:00100000:0.0:1788791520.394387:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791520.394525:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606281344 00000100:00100000:3.0:1788791520.394536:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606281344 00000100:00100000:3.0:1788791520.394673:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 235 00000100:00100000:3.0:1788791520.394682:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:5597:x1875683606281344:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791520.394698:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791520.394716:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16ce00/0xcd6380150a322d8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f36 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791520.394744:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16ce00/0xcd6380150a322d8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f36 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791520.394755:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16ce00/0xcd6380150a322d8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f36 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791520.394765:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16ce00, rc 0) 00000100:00100000:3.0:1788791520.394883:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:5597:x1875683606281344:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 201us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791520.394907:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 235 00000100:00100000:0.0:1788791520.416686:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791520.417155:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606281472 00000100:00100000:3.0:1788791520.417166:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606281472 00000100:00100000:3.0:1788791520.417221:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 236 00000100:00100000:3.0:1788791520.417231:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:5597:x1875683606281472:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791520.417534:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:5597:x1875683606281472:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 302us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791520.417542:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 236 00000100:00100000:2.0:1788791520.422829:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791520.422928:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606281600 00000100:00100000:1.0:1788791520.422938:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606281600 00000100:00100000:1.0:1788791520.422998:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 237 00000100:00100000:1.0:1788791520.423007:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:5597:x1875683606281600:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791520.423274:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:5597:x1875683606281600:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 267us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791520.423290:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 237 10000000:01000000:1.0:1788791520.804160:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788791520.804167:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ab9818e0800 from 7 10000000:01000000:1.0:1788791520.804171:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788791520.804217:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322d91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791520.804226:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322d91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791520.804245:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322d91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791520.804274:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc00aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630433792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788791520.804347:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791520.804402:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8665a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788791520.804511:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630433792 00000100:00100000:3.0:1788791520.804519:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630433792 00000100:00100000:3.0:1788791520.804572:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788791520.804581:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630433792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791520.804594:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791520.804608:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16d600/0xcd6380150a322d98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322d91 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791520.804628:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16d600/0xcd6380150a322d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322d91 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791520.804638:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16d600/0xcd6380150a322d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322d91 expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791520.804647:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d600, rc 0) 00000100:00100000:3.0:1788791520.804704:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630433792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791520.804710:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788791520.804762:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc00aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630433792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791520.804777:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322d91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322d98 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791520.804785:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322d91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322d98 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791520.805174:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8627b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630433920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791520.805204:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791520.805226:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba89179a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788791520.805254:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630433920 00000100:00100000:3.0:1788791520.805260:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630433920 00000100:00100000:3.0:1788791520.805285:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788791520.805292:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630433920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791520.805540:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630433920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791520.805548:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788791520.805659:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8627b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630433920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791520.805689:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8508ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630434048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788791520.805727:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791520.805753:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abaa0043f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791520.805804:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630434048 00000100:00100000:3.0:1788791520.805808:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630434048 00000100:00100000:3.0:1788791520.805864:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788791520.805871:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630434048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788791520.806024:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630434048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791520.806031:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788791520.806107:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8508ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630434048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788791520.808520:0:11188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788791520.808673:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788791520.808694:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788791520.808705:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322d91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322d98 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791520.808716:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322d98 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791520.808726:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788791520.808728:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ababbc61000 from 7 10000000:01000000:2.0:1788791520.808730:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788791520.808765:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2171200/0xcd6380150a322d9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791520.808775:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abac2171200/0xcd6380150a322d9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791520.808802:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abac2171200/0xcd6380150a322d9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791520.808951:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8508f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630434176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788791520.809019:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791520.809107:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abaa0043cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791520.809309:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630434176 00000100:00100000:1.0:1788791520.809318:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630434176 00000100:00100000:0.0:1788791520.809468:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788791520.809479:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630434176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788791520.809491:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791520.809505:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994ffa00/0xcd6380150a322da6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322d9f expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791520.809530:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ffa00/0xcd6380150a322da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322d9f expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791520.809541:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994ffa00/0xcd6380150a322da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322d9f expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791520.809562:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ffa00, rc 0) 00000100:00100000:0.0:1788791520.809614:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630434176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791520.809620:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788791520.809692:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8508f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630434176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788791520.809706:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abac2171200/0xcd6380150a322d9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322da6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791520.809715:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abac2171200/0xcd6380150a322d9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322da6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791520.809767:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc009880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630434304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791520.809802:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791520.809946:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8665a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791520.810035:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630434304 00000100:00100000:2.0:1788791520.810040:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630434304 00000100:00100000:2.0:1788791520.810064:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788791520.810071:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630434304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791520.810497:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630434304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 424us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791520.810504:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788791520.810613:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc009880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630434304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788791520.810714:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630434432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788791520.810756:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791520.810784:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9924f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788791520.810808:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630434432 00000100:00100000:3.0:1788791520.810812:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630434432 00000100:00100000:3.0:1788791520.810882:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788791520.810898:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630434432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788791520.811045:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630434432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791520.811052:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788791520.811070:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630434432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788791520.812385:0:11189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788791520.812669:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788791520.812693:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788791520.812702:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2171200/0xcd6380150a322d9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322da6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791520.812713:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abac2171200/0xcd6380150a322d9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322da6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791520.812780:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788791520.812783:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9aba98e4f000 from 7 10000000:01000000:0.0:1788791520.812786:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788791520.812925:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a322dad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791520.812936:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a322dad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791520.812947:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a322dad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791520.812967:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630434560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788791520.813014:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791520.817628:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630434560 00000100:00100000:2.0:1788791520.817647:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630434560 00000100:00100000:0.0:1788791520.817679:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9924f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788791520.817742:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788791520.817752:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630434560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788791520.817785:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791520.817805:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994fe200/0xcd6380150a322db4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322dad expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791520.817847:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994fe200/0xcd6380150a322db4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322dad expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791520.817858:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994fe200/0xcd6380150a322db4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322dad expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791520.817867:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe200, rc 0) 00000100:00100000:0.0:1788791520.817923:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630434560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (4907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791520.817930:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788791520.817981:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630434560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788791520.817999:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a322dad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322db4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791520.818008:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a322dad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322db4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791520.818074:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630434688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788791520.818107:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791520.818161:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9924f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788791520.818568:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630434688 00000100:00100000:1.0:1788791520.818574:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630434688 00000100:00100000:1.0:1788791520.818610:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788791520.819973:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630434688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788791520.820268:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630434688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1650us (2160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791520.820285:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788791520.820437:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630434688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791520.820479:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc009500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630434816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791520.820518:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791520.820553:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8665a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788791520.820590:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630434816 00000100:00100000:2.0:1788791520.820596:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630434816 00000100:00100000:2.0:1788791520.820633:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788791520.820642:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630434816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791520.820955:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc009500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630434816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788791520.821455:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630434816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 812us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791520.821464:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000040:00080000:1.0:1788791520.821699:0:11190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788791520.821874:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788791520.821895:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788791520.821914:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a322dad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322db4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791520.822493:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a322dad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322db4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791520.933021:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791521.955652:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791522.866717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791522.866768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791522.866793:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791522.866937:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606281728 00000100:00100000:3.0:1788791522.866950:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606281728 00000100:00100000:3.0:1788791522.867009:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 247 00000100:00100000:3.0:1788791522.867020:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2355:x1875683606281728:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791522.867091:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2355:x1875683606281728:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 73us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791522.867099:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 247 00000100:00100000:3.0:1788791522.867160:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606281984 00000100:00100000:3.0:1788791522.867164:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606281984 00000100:00100000:3.0:1788791522.867213:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606281856 00000100:00100000:3.0:1788791522.867217:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606281856 00000100:00100000:3.0:1788791522.867241:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:3.0:1788791522.867248:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606281984:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791522.867281:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606281984:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 34us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791522.867287:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:3.0:1788791522.867298:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00100000:3.0:1788791522.867304:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606281856:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791522.867326:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606281856:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 23us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791522.867332:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00080000:3.0:1788791522.867455:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788791522.980860:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788791523.927300:0:11366:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788791524.003695:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791524.643945:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630435328:0@lo:400:kworker.0 00000100:00100000:1.0:1788791524.644016:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791524.644080:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788791524.644087:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630434944:0@lo:400:kworker.0 00000100:00100000:1.0:1788791524.644156:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791524.644186:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630435456:0@lo:400:kworker.0 00000100:00100000:1.0:1788791524.644213:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791524.644237:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630435072:0@lo:400:kworker.0 00000100:00100000:1.0:1788791524.644258:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791524.644273:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630435584:0@lo:400:kworker.0 00000100:00100000:1.0:1788791524.644292:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791524.644310:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791524.644315:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc00b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630435200:0@lo:400:kworker.0 00000100:00100000:1.0:1788791524.644337:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791524.644367:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630435328 00000100:00100000:1.0:1788791524.644374:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630435328 00000100:00100000:1.0:1788791524.644418:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630435584 00000100:00100000:1.0:1788791524.644421:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630435584 00000100:00100000:1.0:1788791524.644443:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788791524.644452:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630435328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791524.644516:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc00ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630435328:12345-0@lo:400:kworker.0 Request processed in 51us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791524.644523:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788791524.644540:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788791524.644546:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630435584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791524.644584:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630435584:12345-0@lo:400:kworker.0 Request processed in 39us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791524.644590:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788791524.644624:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababc008380 x1875683630435584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791524.644647:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630435584:0@lo:400:kworker.0 00010000:00080000:1.0:1788791524.644673:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababc008700 x1875683630435328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791524.644681:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630435328:0@lo:400:kworker.0 00000100:00100000:3.0:1788791524.644917:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630434944 00000100:00100000:3.0:1788791524.644922:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630434944 00000100:00100000:3.0:1788791524.644947:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788791524.644953:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3312:x1875683630434944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791524.644986:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3312:x1875683630434944:12345-0@lo:400:kworker.0 Request processed in 34us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791524.644992:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788791524.645016:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630435456 00000100:00100000:3.0:1788791524.645018:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630435456 00000100:00100000:3.0:1788791524.645038:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630435072 00000100:00100000:3.0:1788791524.645041:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630435072 00000100:00100000:3.0:1788791524.645051:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630435200 00000100:00100000:3.0:1788791524.645053:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630435200 00000100:00100000:3.0:1788791524.645064:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788791524.645070:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc00b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630435456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791524.645162:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc00b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630435456:12345-0@lo:400:kworker.0 Request processed in 91us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791524.645179:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788791524.645192:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788791524.645198:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc00b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630435072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791524.645228:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc00b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630435072:12345-0@lo:400:kworker.0 Request processed in 31us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791524.645234:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788791524.645245:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788791524.645251:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630435200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791524.645279:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630435200:12345-0@lo:400:kworker.0 Request processed in 28us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791524.645291:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1788791524.645315:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788791524.645319:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788791524.645321:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788791524.645634:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc00b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630435200:0@lo:400:kworker.0 00000100:00100000:1.0:1788791524.645644:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630435072:0@lo:400:kworker.0 00000100:00100000:0.0:1788791524.646102:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788791524.646115:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630435712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791524.646230:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791524.646276:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630435712 00000100:00100000:0.0:1788791524.646282:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630435712 00000100:00100000:0.0:1788791524.646322:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788791524.646330:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630435712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788791524.646358:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791524.646409:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630435712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791524.646415:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788791524.646448:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb485880 x1875683630435712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791540 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791524.646462:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb485880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630435712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791524.646503:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630434944:0@lo:400:kworker.0 00000100:00100000:0.0:1788791524.646515:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630435456:0@lo:400:kworker.0 00010000:00010000:0.0:1788791525.031545:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791525.157517:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630435840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791525.157604:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791525.157692:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630435840 00000100:00100000:0.0:1788791525.157710:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630435840 00000100:00100000:0.0:1788791525.157759:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788791525.157768:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630435840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788791525.157801:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791525.157852:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb485880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630435840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791525.157860:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788791525.157900:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababc008e00 x1875683630435840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791525.157918:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630435840:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788791526.052295:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791527.078560:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788791527.395660:0:11467:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 10:32:05 (1788791525) === 00000100:00100000:0.0:1788791527.608405:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791527.608495:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791527.608570:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606282112 00000100:00100000:1.0:1788791527.608579:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606282112 00000100:00100000:1.0:1788791527.608677:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:1.0:1788791527.608689:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2353:x1875683606282112:12345-192.168.201.29@tcp:41:mkdir.0 00000004:00000024:1.0:1788791527.608743:0:8351:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788791527.608827:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb487800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2353:x1875683606282112:12345-192.168.201.29@tcp:41:mkdir.0 Request processed in 142us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791527.608836:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00080000:2.0:1788791527.608892:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791527.609439:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606282240 00000100:00100000:2.0:1788791527.609446:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606282240 00000100:00100000:2.0:1788791527.609524:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1788791527.609532:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:9684:x1875683606282240:12345-192.168.201.29@tcp:700:mkdir.0 00000100:00100000:2.0:1788791527.609583:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb484e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:9684:x1875683606282240:12345-192.168.201.29@tcp:700:mkdir.0 Request processed in 51us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791527.609590:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:0.0:1788791527.616173:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791527.616283:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606282496 00000100:00100000:3.0:1788791527.616294:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606282496 00000100:00100000:3.0:1788791527.616351:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:3.0:1788791527.616361:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:9684:x1875683606282496:12345-192.168.201.29@tcp:36:mkdir.0 00010000:00010000:3.0:1788791527.616416:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791527.616490:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170600/0xcd6380150a322c9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674eb8 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.616522:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba8533f900) 00010000:00010000:3.0:1788791527.616535:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788791527.617197:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a322dbb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.617213:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a322dbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.617222:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a322dbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.617256:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a322dc2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.617264:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a322dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.617283:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a322dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791527.620235:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1788791527.620253:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a322dbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.620263:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a322dbb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.620270:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a322dbb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.620275:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c800 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791527.620279:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a322dbb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.620298:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a322dbb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.620316:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba8823c100) 00010000:00010000:0.0:1788791527.620319:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791527.620325:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a322dbb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.620331:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a322dbb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788791527.620351:0:5839:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000025fb5265 reply state 00000000bf95f403 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a322dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791527.620360:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788791527.620957:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:9684:x1875683606282496:12345-192.168.201.29@tcp:36:mkdir.0 Request processed in 4592us (4833us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788791527.620967:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00010000:00010000:2.0:1788791527.623593:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a322dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791527.623610:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a322dc2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791527.623617:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a322dc2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791527.623622:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16da00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791527.623627:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a322dc2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791527.623652:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a322dc2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791527.623671:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9aba8823c200) 00010000:00010000:2.0:1788791527.623674:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791527.623679:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a322dc2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791527.623686:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a322dc2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791527.640793:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791527.641015:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606282624 00000100:00100000:1.0:1788791527.641035:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606282624 00000100:00100000:1.0:1788791527.641250:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1788791527.641261:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:9685:x1875683606282624:12345-192.168.201.29@tcp:101:chmod.0 00010000:00010000:1.0:1788791527.641282:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791527.641305:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a322dc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f3d expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.641366:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524600/0xcd6380150a322dd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.641392:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524600/0xcd6380150a322dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.641405:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524600/0xcd6380150a322dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791527.641484:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788791527.641488:0:8351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791527.641529:0:8351:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524600/0xcd6380150a322dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.641554:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a322dc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f3d expref: 8 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.641573:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524600/0xcd6380150a322dd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f3d expref: 7 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.641582:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:1.0:1788791527.641584:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788791527.641588:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba81524600, rc 0) 00000100:00100000:1.0:1788791527.641639:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:9685:x1875683606282624:12345-192.168.201.29@tcp:101:chmod.0 Request processed in 380us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791527.641646:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:3.0:1788791527.645387:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791527.645429:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606282880 00000100:00100000:1.0:1788791527.645438:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606282880 00000100:00100000:1.0:1788791527.645587:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:1.0:1788791527.645599:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:9685:x1875683606282880:12345-192.168.201.29@tcp:36:chmod.0 00010000:00010000:1.0:1788791527.645656:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791527.645696:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524600/0xcd6380150a322dd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f3d expref: 7 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.645714:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:1.0:1788791527.645723:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788791527.645749:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322dd7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.645761:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.645770:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788791527.646074:0:5837:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000005f2a9529 reply state 00000000a081ae85 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791527.646084:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788791527.646097:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1788791527.646227:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:9685:x1875683606282880:12345-192.168.201.29@tcp:36:chmod.0 Request processed in 630us (845us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788791527.646235:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00010000:00010000:1.0:1788791527.647933:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322dd7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.647950:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322dd7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.647957:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322dd7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.647963:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81525c00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791527.647980:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322dd7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.647987:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322dd7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.648003:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ababb052200) 00010000:00010000:1.0:1788791527.648007:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788791527.648011:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322dd7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.648030:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322dd7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791527.677941:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791527.678302:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606283008 00000100:00100000:0.0:1788791527.678313:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606283008 00000100:00100000:0.0:1788791527.678377:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1788791527.678388:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:9686:x1875683606283008:12345-192.168.201.29@tcp:101:chown.0 00010000:00010000:0.0:1788791527.678410:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791527.678444:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322dde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f44 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.678872:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a322de5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.678898:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a322de5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.678909:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a322de5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791527.678969:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1788791527.678973:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791527.679016:0:5836:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a322de5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.679043:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322dde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f44 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.679061:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a322de5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f44 expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.679070:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba94530f00) 00010000:00010000:0.0:1788791527.679073:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788791527.679077:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe600, rc 0) 00000100:00100000:0.0:1788791527.679313:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:9686:x1875683606283008:12345-192.168.201.29@tcp:101:chown.0 Request processed in 925us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791527.679321:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:2.0:1788791527.683694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791527.683864:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606283136 00000100:00100000:0.0:1788791527.683873:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606283136 00000100:00100000:0.0:1788791527.683970:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:0.0:1788791527.683981:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:9686:x1875683606283136:12345-192.168.201.29@tcp:101:chown.0 00010000:00010000:0.0:1788791527.684001:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791527.684032:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a322dec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f4b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684099:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322df3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684113:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322df3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684162:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322df3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684178:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322dfa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684185:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322dfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684191:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322dfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684285:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a322e01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684293:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a322e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684299:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a322e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791527.684335:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1788791527.684339:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791527.684360:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a322e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684378:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322df3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684386:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322df3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684392:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322df3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684398:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791527.684402:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322df3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684409:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322df3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684420:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba94530f00) 00010000:00010000:0.0:1788791527.684423:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791527.684654:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322df3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684663:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322df3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684677:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322dfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684682:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322dfa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684906:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322dfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684919:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791527.684922:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322dfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684928:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322dfa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684938:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9aba94530e00) 00010000:00010000:0.0:1788791527.684941:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791527.684944:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322dfa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684950:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322dfa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684982:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a322dec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f4b expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.684996:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a322e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f4b expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.685003:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9aba94530b00) 00010000:00010000:0.0:1788791527.685006:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788791527.685008:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ffc00, rc 0) 00000100:00100000:0.0:1788791527.685075:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:9686:x1875683606283136:12345-192.168.201.29@tcp:101:chown.0 Request processed in 1095us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791527.685083:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:2.0:1788791527.688699:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791527.688980:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606283392 00000100:00100000:1.0:1788791527.688989:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606283392 00000100:00100000:1.0:1788791527.689076:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:1.0:1788791527.689087:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:9686:x1875683606283392:12345-192.168.201.29@tcp:36:chown.0 00010000:00010000:1.0:1788791527.689181:0:8351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791527.689207:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a322e01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f4b expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.689224:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9aba94530b00) 00010000:00010000:1.0:1788791527.689233:0:8351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788791527.689257:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322e08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.689268:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322e08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.689277:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322e08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788791527.729319:0:8351:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000bedd9786 reply state 000000008f1e6660 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322e08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791527.729336:0:8351:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788791527.729498:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000001:00080000:2.0:1788791527.729675:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:2.0:1788791527.729700:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00080000:3.0:1788791527.729734:0:8351:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788791527.729765:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:9686:x1875683606283392:12345-192.168.201.29@tcp:36:chown.0 Request processed in 40675us (41071us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788791527.729774:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00010000:00010000:2.0:1788791527.730067:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322e08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791527.730078:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322e08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791527.730086:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322e08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791527.730092:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81525c00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791527.730097:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322e08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791527.730105:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322e08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791527.730175:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9ababb052200) 00010000:00010000:2.0:1788791527.730179:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788791527.730183:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322e08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791527.730189:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322e08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791527.747950:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791527.748036:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606283520 00000100:00100000:1.0:1788791527.748046:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606283520 00000100:00100000:1.0:1788791527.748151:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:1.0:1788791527.748165:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:9687:x1875683606283520:12345-192.168.201.29@tcp:101:touch.500 00010000:00010000:1.0:1788791527.748192:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791527.748214:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a322e0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f52 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788791527.752200:0:5837:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3933us 00010000:00010000:3.0:1788791527.758433:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322e16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.758456:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322e16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.758468:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322e16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.758485:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322e1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.758492:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322e1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.758499:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322e1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.758923:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322e24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.758932:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.758939:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791527.759014:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788791527.759018:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788791527.759289:0:5837:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322e24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.759304:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322e16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.759311:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322e16 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.759317:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322e16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.759324:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791527.759328:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322e16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.759336:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322e16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.759350:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba94530f00) 00010000:00010000:3.0:1788791527.759360:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791527.759366:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322e16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.759372:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322e16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.759383:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322e1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.759388:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322e1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.759394:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322e1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.759399:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791527.759402:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322e1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.759408:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322e1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.759416:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9aba8823c500) 00010000:00010000:3.0:1788791527.759419:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791527.759422:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322e1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.759427:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322e1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.759466:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a322e0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f52 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.759494:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322e24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f52 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.759502:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:3.0:1788791527.759504:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788791527.759506:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16cc00, rc 0) 00000100:00100000:3.0:1788791527.759580:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:9687:x1875683606283520:12345-192.168.201.29@tcp:101:touch.500 Request processed in 11417us (11641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791527.759589:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:2.0:1788791527.765750:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791527.765832:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606283776 00000100:00100000:0.0:1788791527.765853:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606283776 00000100:00100000:0.0:1788791527.765909:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:0.0:1788791527.765918:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:9687:x1875683606283776:12345-192.168.201.29@tcp:101:touch.500 00010000:00010000:0.0:1788791527.765937:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791527.765955:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a322e2b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f59 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.766269:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322e32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.766282:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322e32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.766292:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322e32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.766336:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322e39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.766343:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322e39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.766350:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322e39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788791527.767787:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788791527.768076:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322e40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.768089:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.768107:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.768656:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322e32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.768665:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322e32 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.768672:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322e32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.768678:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791527.768682:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322e32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.768753:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322e32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.768766:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:0.0:1788791527.768768:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791527.768773:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322e32 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.768780:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322e32 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788791527.768792:0:5836:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000036aae6d reply state 00000000b6cf55b6 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322e39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791527.768801:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788791527.768846:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a322e2b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f59 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.768861:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322e40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f59 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.768868:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9aba94530a00) 00010000:00010000:0.0:1788791527.768870:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788791527.768872:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fea00, rc 0) 00000100:00100000:0.0:1788791527.768990:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:9687:x1875683606283776:12345-192.168.201.29@tcp:101:touch.500 Request processed in 3071us (3247us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788791527.768998:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:2.0:1788791527.772925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791527.772988:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606284032 00000100:00100000:0.0:1788791527.772998:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606284032 00000100:00100000:0.0:1788791527.773056:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:0.0:1788791527.773067:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:9687:x1875683606284032:12345-192.168.201.29@tcp:36:touch.500 00010000:00010000:0.0:1788791527.773172:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791527.773199:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322e40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f59 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.773218:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9aba94530a00) 00010000:00010000:0.0:1788791527.773230:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788791527.773295:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a322e4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.773307:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a322e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.773315:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a322e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788791527.773451:0:5839:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000d0cf2dae reply state 00000000e357742c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a322e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791527.773461:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788791527.773556:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+11:9687:x1875683606284032:12345-192.168.201.29@tcp:36:touch.500 Request processed in 490us (641us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788791527.773563:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:2.0:1788791527.776644:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:3.0:1788791527.776720:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a322e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.776732:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a322e4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.776739:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a322e4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.776745:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ffe00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791527.776750:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a322e4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.776758:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a322e4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.776773:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9aba94530900) 00010000:00010000:3.0:1788791527.776777:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791527.776781:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a322e4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.776801:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a322e4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791527.776919:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606284160 00000100:00100000:0.0:1788791527.776930:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606284160 00000100:00100000:0.0:1788791527.776984:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:0.0:1788791527.776994:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:9687:x1875683606284160:12345-192.168.201.29@tcp:101:touch.500 00010000:00010000:0.0:1788791527.777016:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791527.777035:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a322e55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f60 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.777092:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a322e55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f60 expref: 11 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.777106:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a322e55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f60 expref: 11 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.777162:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9aba94530100) 00010000:00010000:0.0:1788791527.777165:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788791527.777168:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe400, rc 0) 00000100:00100000:0.0:1788791527.777221:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+11:9687:x1875683606284160:12345-192.168.201.29@tcp:101:touch.500 Request processed in 228us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791527.777229:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00010000:00010000:1.0:1788791527.781289:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322e39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.781308:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322e39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.781317:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322e39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.781323:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791527.781328:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322e39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.781337:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322e39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.781356:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3e0961b7 (ffff9aba94530e00) 00010000:00010000:1.0:1788791527.781360:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791527.781364:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322e39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.781389:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322e39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791527.788482:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791527.788610:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606284288 00000100:00100000:1.0:1788791527.788621:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606284288 00000100:00100000:1.0:1788791527.788675:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1788791527.788684:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1875683606284288:12345-192.168.201.29@tcp:8:touch.500 00010000:00080000:1.0:1788791527.788726:0:6682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:1.0:1788791527.788759:0:6682:0:(genops.c:1385:class_connect()) connect: client aafa64f5-7c0a-45ff-aeda-f3a6deb3b804, cookie 0xcd6380150a322e5c 00002000:00100000:1.0:1788791527.788771:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aafa64f5-7c0a-45ff-aeda-f3a6deb3b804/ffff9aba851e3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788791527.788795:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788791527.789040:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788791527.789069:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9aba851e0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788791527.789176:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2351:x1875683606284288:12345-192.168.201.29@tcp:8:touch.500 Request processed in 491us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791527.789184:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:2.0:1788791527.791718:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791527.791844:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606284416 00000100:00100000:3.0:1788791527.791853:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606284416 00000100:00100000:3.0:1788791527.791923:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:3.0:1788791527.791934:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:0:x1875683606284416:12345-192.168.201.29@tcp:2:touch.500 00000100:00080000:2.0:1788791527.792072:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1788791527.868556:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00000001:00080000:2.0:1788791527.868578:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:3.0:1788791527.868840:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:0:x1875683606284416:12345-192.168.201.29@tcp:2:touch.500 Request processed in 76902us (77127us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788791527.868851:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1788791527.871575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791527.871661:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606284672 00000100:00100000:1.0:1788791527.871669:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606284672 00000100:00100000:1.0:1788791527.871738:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:1.0:1788791527.871748:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:9687:x1875683606284672:12345-192.168.201.29@tcp:35:touch.500 00000100:00100000:1.0:1788791527.872094:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+11:9687:x1875683606284672:12345-192.168.201.29@tcp:35:touch.500 Request processed in 346us (527us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788791527.872103:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:2.0:1788791527.893013:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791527.893165:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606284800 00000100:00100000:0.0:1788791527.893177:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606284800 00000100:00100000:0.0:1788791527.893245:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:0.0:1788791527.893256:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+11:9688:x1875683606284800:12345-192.168.201.29@tcp:101:rm.0 00010000:00010000:0.0:1788791527.893281:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791527.893303:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322e63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f67 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.893365:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a322e6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.893379:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a322e6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.893389:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a322e6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791527.893457:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788791527.893461:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791527.893514:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a322e6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.893542:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322e63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f67 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.893559:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a322e6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f67 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.893568:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:0.0:1788791527.893585:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788791527.893588:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff200, rc 0) 00000100:00100000:0.0:1788791527.893655:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+12:9688:x1875683606284800:12345-192.168.201.29@tcp:101:rm.0 Request processed in 400us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791527.893663:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:0.0:1788791527.904454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791527.904609:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606285056 00000100:00100000:3.0:1788791527.904619:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606285056 00000100:00100000:3.0:1788791527.904702:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:3.0:1788791527.904713:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+12:9688:x1875683606285056:12345-192.168.201.29@tcp:101:rm.0 00010000:00010000:3.0:1788791527.904736:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791527.904757:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322e71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f6e expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791527.904870:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1788791527.905028:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322e71 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f6e expref: 14 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.905044:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba94530f00) 00010000:00010000:3.0:1788791527.905047:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788791527.905053:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322e71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f6e expref: 14 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.905078:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c200, rc 0) 00000100:00100000:3.0:1788791527.905192:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:9688:x1875683606285056:12345-192.168.201.29@tcp:101:rm.0 Request processed in 481us (748us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1788791527.905200:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:2.0:1788791527.912371:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791527.912545:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606285184 00000100:00100000:1.0:1788791527.912556:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606285184 00000100:00100000:1.0:1788791527.912793:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:1.0:1788791527.912803:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:9688:x1875683606285184:12345-192.168.201.29@tcp:37:rm.0 00000100:00100000:0.0:1788791527.918395:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:9688:x1875683606285184:12345-192.168.201.29@tcp:37:rm.0 Request processed in 5580us (6022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791527.918413:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:2.0:1788791527.926457:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791527.926577:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606285440 00000100:00100000:3.0:1788791527.926591:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606285440 00000100:00100000:3.0:1788791527.926660:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:3.0:1788791527.926679:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba9921e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:9688:x1875683606285440:12345-192.168.201.29@tcp:35:rm.0 00000100:00100000:3.0:1788791527.926939:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba9921e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:9688:x1875683606285440:12345-192.168.201.29@tcp:35:rm.0 Request processed in 269us (491us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788791527.926948:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:2.0:1788791527.930785:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791527.930891:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606285696 00000100:00100000:0.0:1788791527.930902:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606285696 00000100:00100000:0.0:1788791527.930968:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:0.0:1788791527.930979:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:9688:x1875683606285696:12345-192.168.201.29@tcp:101:rm.0 00010000:00010000:0.0:1788791527.931002:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791527.931023:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322e7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f75 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.931190:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a322e86 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.931205:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a322e86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.931216:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a322e86 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791527.931227:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1788791527.931394:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a322e7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f75 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.931427:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a322e86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f75 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.931436:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:0.0:1788791527.931439:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788791527.931443:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff600, rc 0) 00000100:00100000:0.0:1788791527.931516:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+16:9688:x1875683606285696:12345-192.168.201.29@tcp:101:rm.0 Request processed in 539us (740us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788791527.931523:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:2.0:1788791527.935622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791527.935796:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606285824 00000100:00100000:3.0:1788791527.935807:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606285824 00000100:00100000:3.0:1788791527.935864:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:3.0:1788791527.935875:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+16:9688:x1875683606285824:12345-192.168.201.29@tcp:41:rm.0 00000004:00000024:3.0:1788791527.936023:0:8351:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788791527.936100:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+16:9688:x1875683606285824:12345-192.168.201.29@tcp:41:rm.0 Request processed in 226us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791527.936108:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:2.0:1788791527.939771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791527.939923:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606285952 00000100:00100000:0.0:1788791527.939934:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606285952 00000100:00100000:0.0:1788791527.940100:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:0.0:1788791527.940121:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+16:9688:x1875683606285952:12345-192.168.201.29@tcp:101:rm.0 00010000:00010000:0.0:1788791527.940171:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791527.940193:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a322e94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f7c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940259:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a322e9b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940273:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a322e9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940284:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a322e9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940298:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322ea2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940321:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940329:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940447:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322ea9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940457:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940464:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791527.940489:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788791527.940492:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791527.940807:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940821:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940828:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a322e9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940835:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a322e9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940841:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a322e9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940857:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791527.940861:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a322e9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940867:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a322e9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940879:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:0.0:1788791527.940882:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791527.940886:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a322e9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940892:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a322e9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940907:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940913:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322ea2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940918:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940923:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fea00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791527.940925:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.940931:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322ea2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.941009:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3e0961b7 (ffff9aba94530a00) 00010000:00010000:0.0:1788791527.941012:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791527.941016:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322ea2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.941022:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322ea2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.941059:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a322e94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f7c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.941071:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f7c expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.941078:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9aba94530100) 00010000:00010000:0.0:1788791527.941081:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788791527.941083:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe000, rc 0) 00000100:00100000:0.0:1788791527.941194:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+17:9688:x1875683606285952:12345-192.168.201.29@tcp:101:rm.0 Request processed in 1084us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791527.941202:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:2.0:1788791527.944162:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791527.944373:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606286208 00000100:00100000:3.0:1788791527.944385:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606286208 00000100:00100000:3.0:1788791527.944458:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:3.0:1788791527.944468:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+17:9688:x1875683606286208:12345-192.168.201.29@tcp:36:rm.0 00010000:00010000:3.0:1788791527.944531:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788791527.944566:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a322ea9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f7c expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.944587:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a322e55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f60 expref: 16 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.944597:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9aba94530100) 00010000:00010000:3.0:1788791527.944613:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a322e6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f67 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.944839:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:3.0:1788791527.944844:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788791527.944864:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eb0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.944878:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.944888:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.944904:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322eb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.944910:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.944917:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.945236:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322ebe lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.945251:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322ebe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.945258:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322ebe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788791527.946312:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788791527.946325:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 304326197870ns, next at 305326195294ns, rc = 0 00010000:00010000:3.0:1788791527.946389:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a322ec5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946401:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a322ec5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946409:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a322ec5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946430:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a322ec5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946438:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a322ec5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946444:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a322ec5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946576:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791527.946598:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322ebe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946605:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322ebe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946620:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322ebe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946626:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791527.946630:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322ebe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946637:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322ebe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946649:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9aba8823c500) 00010000:00010000:3.0:1788791527.946651:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788791527.946656:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322ebe lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946662:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322ebe lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946678:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946843:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eb0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946851:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eb0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946856:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791527.946859:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eb0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946877:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eb0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946886:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:3.0:1788791527.946888:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791527.946891:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eb0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.946897:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eb0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788791527.946907:0:5836:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000092e8cb92 reply state 000000008d52ecac transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791527.946917:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788791527.947079:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+16:9688:x1875683606286208:12345-192.168.201.29@tcp:36:rm.0 Request processed in 2608us (2962us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788791527.947088:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:0.0:1788791527.954704:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:3.0:1788791527.955280:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.955294:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322eb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.955303:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322eb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.955309:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791527.955315:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322eb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.955342:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322eb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.955360:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3e0961b7 (ffff9aba8823c000) 00010000:00010000:3.0:1788791527.955363:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791527.955368:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322eb7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.955375:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322eb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3e0961b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791527.955438:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606286464 00000100:00100000:3.0:1788791527.955448:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606286464 00000100:00100000:3.0:1788791527.955495:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788791527.955516:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+15:9688:x1875683606286464:12345-192.168.201.29@tcp:35:rm.0 00000100:00100000:3.0:1788791527.955885:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+16:9688:x1875683606286464:12345-192.168.201.29@tcp:35:rm.0 Request processed in 380us (1200us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788791527.955892:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00010000:00010000:1.0:1788791527.957755:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791527.957768:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a322ec5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.957778:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791527.957783:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a322ec5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.957792:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a322ec5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.957810:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9aba8823c500) 00010000:00010000:1.0:1788791527.957814:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788791527.957818:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a322ec5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791527.957823:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a322ec5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791527.957953:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791527.957957:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791527.957959:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791527.958393:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791527.958803:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606286720 00000100:00100000:3.0:1788791527.958815:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606286720 00000100:00100000:3.0:1788791527.958874:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:3.0:1788791527.958884:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+16:9688:x1875683606286720:12345-192.168.201.29@tcp:36:rm.0 00010000:00010000:3.0:1788791527.958935:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788791527.958953:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a322e86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f75 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.958969:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322e24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f52 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.958993:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:3.0:1788791527.959007:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a322de5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f44 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.959016:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba94530f00) 00010000:00010000:3.0:1788791527.959023:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788791527.959044:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d800/0xcd6380150a322ecc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.959056:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d800/0xcd6380150a322ecc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.959064:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d800/0xcd6380150a322ecc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.959075:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c600/0xcd6380150a322ed3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.959082:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c600/0xcd6380150a322ed3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.959089:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c600/0xcd6380150a322ed3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.959946:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eda lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.959957:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.959976:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791527.961313:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1788791527.961330:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eda lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.961340:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eda lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.961346:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.961352:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791527.961357:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eda lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.961364:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eda lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.961377:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:3.0:1788791527.961379:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788791527.961383:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eda lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.961389:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c200/0xcd6380150a322eda lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.961407:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d800/0xcd6380150a322ecc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.961413:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d800/0xcd6380150a322ecc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.961497:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d800/0xcd6380150a322ecc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.961559:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d800 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791527.961563:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d800/0xcd6380150a322ecc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.961569:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d800/0xcd6380150a322ecc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.961577:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba8823c300) 00010000:00010000:3.0:1788791527.961580:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791527.961583:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d800/0xcd6380150a322ecc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.961588:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d800/0xcd6380150a322ecc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788791527.961601:0:5837:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000031c054b9 reply state 00000000654ebbfa transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c600/0xcd6380150a322ed3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791527.961611:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788791527.961809:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb485f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+15:9688:x1875683606286720:12345-192.168.201.29@tcp:36:rm.0 Request processed in 2924us (3417us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788791527.961818:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00010000:00010000:3.0:1788791527.967278:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c600/0xcd6380150a322ed3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.967297:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c600/0xcd6380150a322ed3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.967326:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c600/0xcd6380150a322ed3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.967332:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791527.967337:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c600/0xcd6380150a322ed3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.967345:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c600/0xcd6380150a322ed3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.967362:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9aba8823cd00) 00010000:00010000:3.0:1788791527.967366:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791527.967371:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c600/0xcd6380150a322ed3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791527.967376:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c600/0xcd6380150a322ed3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791527.983638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791527.983736:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791527.983966:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606286976 00000100:00100000:3.0:1788791527.983976:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606286976 00000100:00100000:3.0:1788791527.984057:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:3.0:1788791527.984067:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606286976:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791527.984185:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb486680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606286976:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 119us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791527.984193:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:2.0:1788791527.984439:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606286848 00000100:00100000:2.0:1788791527.984445:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606286848 00000100:00100000:2.0:1788791527.984482:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 249 00000100:00100000:2.0:1788791527.984490:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2355:x1875683606286848:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791527.984545:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2355:x1875683606286848:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 57us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791527.984552:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 249 00000100:00080000:0.0:1788791527.984699:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788791528.102729:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791529.123325:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788791529.763711:0:7980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306143568889ns, next at 307143566606ns, rc = 0 00000100:00100000:3.0:1788791529.763858:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc00b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630435968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791529.763928:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791529.764689:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630435968 00000100:00100000:1.0:1788791529.764710:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630435968 00000100:00100000:1.0:1788791529.764761:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788791529.764770:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8627b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630435968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788791529.764823:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791529.764883:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8627b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630435968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791529.764906:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788791529.764953:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababc00b800 x1875683630435968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791545 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791529.764973:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc00b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630435968:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788791529.765436:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788791529.765456:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630436096:0@lo:400:kworker.0 00000100:00100000:0.0:1788791529.765511:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791529.765548:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630436608:0@lo:400:kworker.0 00000100:00100000:0.0:1788791529.765597:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791529.765619:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788791529.765625:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630436224:0@lo:400:kworker.0 00000100:00100000:0.0:1788791529.765644:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791529.765673:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630436352:0@lo:400:kworker.0 00000100:00100000:0.0:1788791529.765694:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791529.766008:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630436096 00000100:00100000:3.0:1788791529.766024:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630436096 00000100:00100000:3.0:1788791529.766064:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788791529.766074:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630436096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791529.766162:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630436096:12345-0@lo:400:kworker.0 Request processed in 91us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791529.766169:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788791529.766267:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788791529.766275:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630436480:0@lo:400:kworker.0 00000100:00100000:0.0:1788791529.766300:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791529.766328:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630436608 00000100:00100000:0.0:1788791529.766332:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630436608 00000100:00100000:0.0:1788791529.766362:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630436224 00000100:00100000:0.0:1788791529.766365:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630436224 00000100:00100000:0.0:1788791529.766377:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630436352 00000100:00100000:0.0:1788791529.766379:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630436352 00000100:00100000:0.0:1788791529.766394:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788791529.766401:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630436608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791529.766434:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb487480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630436608:12345-0@lo:400:kworker.0 Request processed in 34us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791529.766440:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788791529.766454:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788791529.766461:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630436224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791529.766599:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788791529.766608:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630436352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791529.766647:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb486d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630436352:12345-0@lo:400:kworker.0 Request processed in 41us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791529.766653:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788791529.766799:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630436224:12345-0@lo:400:kworker.0 Request processed in 240us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791529.766806:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788791529.766849:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630436224:0@lo:400:kworker.0 00000100:00100000:0.0:1788791529.766859:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630436096:0@lo:400:kworker.0 00000100:00100000:0.0:1788791529.766869:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630436608:0@lo:400:kworker.0 00000100:00100000:0.0:1788791529.766894:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630436480 00000100:00100000:0.0:1788791529.766898:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630436480 00000100:00100000:0.0:1788791529.767022:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788791529.767031:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630436480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791529.767066:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb486a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630436480:12345-0@lo:400:kworker.0 Request processed in 37us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791529.767072:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788791529.768228:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299df80 x1875683630436480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791529.768242:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630436480:0@lo:400:kworker.0 00000100:00100000:1.0:1788791529.768256:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630436352:0@lo:400:kworker.0 00000100:00080000:1.0:1788791529.768281:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788791529.768286:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788791530.150099:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791530.278829:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630436736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788791530.278899:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791530.282492:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630436736 00000100:00100000:1.0:1788791530.282506:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630436736 00000100:00100000:1.0:1788791530.283367:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788791530.283381:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630436736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788791530.283420:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791530.283502:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630436736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (4603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791530.283510:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788791530.283532:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab299c380 x1875683630436736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791546 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791530.283555:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630436736:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788791531.171638:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788791531.431757:0:11616:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1788791532.196835:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788791532.320594:0:11665:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc52a17740 20000000:00000080:0.0:1788791532.320681:0:11665:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ababb9a6000 uarg=0000000000000000 20000000:01000000:0.0:1788791532.320719:0:11665:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788791532.320725:0:11665:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788791532.320730:0:11665:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788791532.321770:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788791532.322003:0:11665:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788791532.331999:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788791532.332106:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788791532.332213:0:11665:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788791532.332234:0:11665:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788791532.332255:0:11665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9aba81525c00/0xcd6380150a322ee1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.332295:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322d83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f2f expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.332303:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ababb16ce00/0xcd6380150a322d8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f36 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.332312:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ababb16d600/0xcd6380150a322d98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322d91 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.332319:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba994ffa00/0xcd6380150a322da6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322d9f expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.332325:0:11665:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba994fe200/0xcd6380150a322db4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322dad expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.332333:0:11665:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9aba81525c00/0xcd6380150a322ee1 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.332387:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba994fe200/0xcd6380150a322db4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322dad expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.332401:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9aba994fe200/0xcd6380150a322db4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322dad expref: 18 pid: 5831 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791532.332416:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc00b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875683630436864:0@lo:104: 00000100:00100000:1.0:1788791532.332483:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788791532.332540:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba994ffa00/0xcd6380150a322da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322d9f expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.332549:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9aba994ffa00/0xcd6380150a322da6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322d9f expref: 18 pid: 5830 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791532.332563:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc008380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875683630436992:0@lo:104: 00000100:00100000:1.0:1788791532.332586:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788791532.332621:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ababb16d600/0xcd6380150a322d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a322d91 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.332630:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9ababb16d600/0xcd6380150a322d98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a322d91 expref: 18 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791532.332637:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc00a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875683630437120:0@lo:104: 00000100:00100000:1.0:1788791532.332662:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788791532.332685:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ababb16ce00/0xcd6380150a322d8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f36 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.332696:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ababb16ce00/0xcd6380150a322d8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f36 expref: 12 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791532.332705:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc00bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875683630437248:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791532.332757:0:11665:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f2f expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.332766:0:11665:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322d83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f2f expref: 12 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791532.332775:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc008e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875683630437376:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791532.332798:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98da6540 going to sleep for 11 seconds 00000100:00100000:2.0:1788791532.333154:0:5820:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788791532.333168:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630436864 00000100:00100000:2.0:1788791532.333176:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630436864 00000100:00100000:2.0:1788791532.333214:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630436992 00000100:00100000:2.0:1788791532.333217:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630436992 00000100:00100000:2.0:1788791532.333227:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630437120 00000100:00100000:2.0:1788791532.333229:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630437120 00000100:00100000:2.0:1788791532.333240:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788791532.333248:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+5:11665:x1875683630436864:12345-0@lo:104: 00010000:00010000:2.0:1788791532.333261:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a322dad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322db4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.333312:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788791532.333318:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+5:11665:x1875683630436864:12345-0@lo:104: Request processed in 71us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791532.333325:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788791532.333340:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788791532.333358:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+4:11665:x1875683630436992:12345-0@lo:104: 00010000:00010000:2.0:1788791532.333366:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9abac2171200/0xcd6380150a322d9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322da6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.333398:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788791532.333403:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+4:11665:x1875683630436992:12345-0@lo:104: Request processed in 47us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791532.333419:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788791532.333434:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788791532.333440:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2f65850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:11665:x1875683630437120:12345-0@lo:104: 00010000:00010000:2.0:1788791532.333447:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322d98 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.333474:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788791532.333479:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2f65850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+3:11665:x1875683630437120:12345-0@lo:104: Request processed in 40us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791532.333485:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1788791532.333591:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788791532.333597:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a322dad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322db4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.333604:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fec00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791532.333727:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a322dad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322db4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.333738:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a322dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322db4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791532.333744:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a322dad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322db4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791532.333751:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788791532.333782:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a322dad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322db4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.333788:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791532.333814:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a322dad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322db4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.333820:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba994fec00/0xcd6380150a322dad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322db4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.333832:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788791532.333834:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abac2171200/0xcd6380150a322d9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322da6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.333840:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abac2171200 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791532.333842:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abac2171200/0xcd6380150a322d9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322da6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.333849:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abac2171200/0xcd6380150a322d9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322da6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791532.333855:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abac2171200/0xcd6380150a322d9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322da6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791532.333859:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788791532.333872:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abac2171200/0xcd6380150a322d9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322da6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.333877:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791532.333883:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abac2171200/0xcd6380150a322d9f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322da6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.333888:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abac2171200/0xcd6380150a322d9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322da6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.333896:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791532.333905:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a322d98 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.333988:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abaa1b5cc00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791532.333992:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322d91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a322d98 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.334000:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a322d98 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791532.334006:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322d91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a322d98 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791532.334011:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788791532.334025:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322d91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322d98 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.334030:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791532.334056:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322d91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322d98 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.334062:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5cc00/0xcd6380150a322d91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a322d98 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.334074:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791532.334076:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791532.334078:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791532.334097:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630437504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791532.334169:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791532.334205:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788791532.334212:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630437632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791532.334242:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791532.334273:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630437504 00000100:00100000:2.0:1788791532.334279:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630437504 00010000:00010000:2.0:1788791532.334299:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba994fe200/0xcd6380150a322db4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322dad expref: 19 pid: 5831 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791532.334321:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630437632 00000100:00100000:2.0:1788791532.334324:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630437632 00010000:00010000:2.0:1788791532.334336:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba994ffa00/0xcd6380150a322da6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322d9f expref: 20 pid: 5830 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791532.334471:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc00b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875683630436864:0@lo:104: 00000100:00100000:1.0:1788791532.334483:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc008380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875683630436992:0@lo:104: 00000100:00100000:1.0:1788791532.334501:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc00a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875683630437120:0@lo:104: 00000100:00100000:3.0:1788791532.334603:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630437760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788791532.334711:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791532.334812:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630437760 00000100:00100000:1.0:1788791532.334816:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630437760 00010000:00010000:1.0:1788791532.334834:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ababb16d600/0xcd6380150a322d98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322d91 expref: 21 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791532.335063:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791532.335243:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788791532.335252:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9967ad2d-016f-4163-8b2b-d5dc380f4403+21:3312:x1875683630437504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791532.335266:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791532.335272:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba994fe200/0xcd6380150a322db4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322dad expref: 21 pid: 5831 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.335283:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba994fe200/0xcd6380150a322db4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322dad expref: 21 pid: 5831 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.335298:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994fe200/0xcd6380150a322db4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322dad expref: 21 pid: 5831 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.335309:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791532.335343:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9967ad2d-016f-4163-8b2b-d5dc380f4403+20:3312:x1875683630437504:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791532.335357:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788791532.335374:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788791532.335379:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3312:x1875683630437632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791532.335386:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791532.335390:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba994ffa00/0xcd6380150a322da6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322d9f expref: 19 pid: 5830 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.335398:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba994ffa00/0xcd6380150a322da6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322d9f expref: 19 pid: 5830 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.335415:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994ffa00/0xcd6380150a322da6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322d9f expref: 19 pid: 5830 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.335423:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791532.335444:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:3312:x1875683630437632:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791532.335449:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788791532.335462:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788791532.335467:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa001c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:3314:x1875683630437760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791532.335474:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791532.335477:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ababb16d600/0xcd6380150a322d98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a322d91 expref: 17 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.335485:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ababb16d600/0xcd6380150a322d98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a322d91 expref: 17 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.335494:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16d600/0xcd6380150a322d98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a322d91 expref: 17 pid: 5832 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.335501:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791532.335520:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa001c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:3314:x1875683630437760:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791532.335525:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788791532.336005:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630437760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788791532.336047:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630437632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788791532.336056:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630437504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788791532.338067:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc00bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875683630437248:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791532.338083:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc008e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11665:1875683630437376:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791532.338120:0:11665:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9aba81525c00/0xcd6380150a322ee1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791532.338863:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791532.338897:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791532.339320:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606287104 00000100:00100000:1.0:1788791532.339329:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606287104 00000100:00100000:2.0:1788791532.339440:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606287232 00000100:00100000:2.0:1788791532.339444:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606287232 00010000:00010000:2.0:1788791532.339472:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322d83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f2f expref: 14 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791532.339492:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:2.0:1788791532.339500:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+14:2355:x1875683606287232:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791532.339513:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791532.339518:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322d83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f2f expref: 14 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.339528:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322d83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f2f expref: 14 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.339545:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abaa1b5c800/0xcd6380150a322d83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f2f expref: 14 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.339559:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791532.339607:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2355:x1875683606287232:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 107us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791532.339638:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00010000:00010000:1.0:1788791532.339991:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ababb16ce00/0xcd6380150a322d8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f36 expref: 12 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791532.340020:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:1.0:1788791532.340027:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:2355:x1875683606287104:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791532.340045:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791532.340050:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ababb16ce00/0xcd6380150a322d8a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f36 expref: 12 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.340059:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ababb16ce00/0xcd6380150a322d8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f36 expref: 12 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.340070:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16ce00/0xcd6380150a322d8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f36 expref: 12 pid: 5831 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.340081:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9aba81525c00/0xcd6380150a322ee1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.340089:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba81525c00/0xcd6380150a322ee1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.340103:0:8452:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9aba81525c00/0xcd6380150a322ee1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.340110:0:8452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9aba81525c00/0xcd6380150a322ee1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.340150:0:8452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9aba81525c00/0xcd6380150a322ee1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.340158:0:8452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9aba81525c00/0xcd6380150a322ee1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.340164:0:8452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81525c00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791532.340168:0:8452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9aba81525c00/0xcd6380150a322ee1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.340176:0:8452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9aba81525c00/0xcd6380150a322ee1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.340189:0:8452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9aba81525c00/0xcd6380150a322ee1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.340198:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791532.340229:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:2355:x1875683606287104:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 202us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791532.340235:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00010000:00010000:1.0:1788791532.340259:0:11665:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9aba81525c00/0xcd6380150a322ee1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.340266:0:11665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9aba81525c00/0xcd6380150a322ee1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791532.340271:0:11665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba81525c00/0xcd6380150a322ee1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788791532.875108:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000004:00080000:2.0:1788791532.875177:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788791532.875192:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1788791532.875199:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788791532.875496:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630437888:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788791532.875571:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791532.875817:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630437888 00000100:00100000:0.0:1788791532.875826:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630437888 00000100:00100000:0.0:1788791532.875887:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788791532.875909:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630437888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788791532.875935:0:10087:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788791532.875967:0:10087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9ecae7, atime: 0x6a9ecae7, ctime: 0x6a9ecae7, blocks: 0x1 00010000:00010000:0.0:1788791532.875982:0:10087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a322ee8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791532.875999:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=309s v=(0 0) 00010000:00010000:0.0:1788791532.876003:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791532.876010:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a322ee8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791532.876035:0:10087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a322ee8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791532.876045:0:10087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a322ee8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791532.876055:0:10087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a322ee8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788791532.876203:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788791532.876247:0:10087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788791532.876848:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1875683630437888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 939us (1274us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788791532.876857:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:3.0:1788791532.877056:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ababb486300/2, rc 0, transno 4294967300 00000100:00100000:3.0:1788791532.877064:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630437888:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788791532.877532:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791532.877541:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a322ee8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.877552:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fea00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791532.877557:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a322ee8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.877567:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a322ee8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.877590:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a322ee8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.877597:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a322ee8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791532.877738:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791532.877741:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791532.877743:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791533.103165:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791533.103205:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791533.103241:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791533.103284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791533.103312:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606287488 00000100:00100000:0.0:1788791533.103322:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606287488 00000100:00100000:1.0:1788791533.103443:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606287616 00000100:00100000:1.0:1788791533.103448:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606287616 00000100:00100000:1.0:1788791533.103504:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:1.0:1788791533.103515:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2355:x1875683606287616:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791533.103597:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb485c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2355:x1875683606287616:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 84us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791533.103612:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00080000:1.0:1788791533.103735:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788791533.104067:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606287744 00000100:00100000:0.0:1788791533.104072:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606287744 00000100:00100000:0.0:1788791533.104092:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 103 00000100:00100000:0.0:1788791533.104099:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2355:x1875683606287488:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791533.104161:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2355:x1875683606287488:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 62us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791533.104167:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 103 00000100:00100000:0.0:1788791533.104180:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 104 00000100:00100000:0.0:1788791533.104185:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606287744:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791533.104475:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606287360 00000100:00100000:3.0:1788791533.104481:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606287360 00000100:00100000:3.0:1788791533.104517:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 251 00000100:00100000:3.0:1788791533.104524:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:2355:x1875683606287360:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791533.104552:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:2355:x1875683606287360:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 29us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791533.104559:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 251 00000100:00080000:1.0:1788791533.104928:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791533.104986:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606287744:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 799us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791533.104994:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 104 00010000:00010000:0.0:1788791533.220026:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788791533.540151:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788791533.540159:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ab9818e0800 from 7 10000000:01000000:2.0:1788791533.540182:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788791533.540229:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322eef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791533.540241:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322eef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791533.540253:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322eef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791533.540277:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2e09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630438016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788791533.540345:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791533.540400:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791533.541283:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630438016 00000100:00100000:3.0:1788791533.541292:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630438016 00000100:00100000:3.0:1788791533.541354:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788791533.541363:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:5834:x1875683630438016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791533.541377:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791533.541392:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16d800/0xcd6380150a322ef6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322eef expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791533.541416:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16d800/0xcd6380150a322ef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322eef expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791533.541427:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16d800/0xcd6380150a322ef6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322eef expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791533.541436:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d800, rc 0) 00000100:00100000:3.0:1788791533.541491:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630438016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791533.541507:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788791533.542083:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2e09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630438016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791533.542099:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322eef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ef6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791533.542109:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322eef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322ef6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791533.542188:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2e09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630438144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791533.542220:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791533.542253:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791533.542363:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630438144 00000100:00100000:3.0:1788791533.542369:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630438144 00000100:00100000:3.0:1788791533.542454:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788791533.542465:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630438144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791533.542737:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630438144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791533.542744:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788791533.542815:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2e09c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630438144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791533.542847:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630438272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791533.542884:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791533.547605:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98da6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788791533.551915:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630438272 00000100:00100000:2.0:1788791533.551933:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630438272 00000100:00100000:2.0:1788791533.552008:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788791533.552033:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630438272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788791533.552320:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630438272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 290us (9434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791533.552335:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788791533.552530:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630438272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791533.552978:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:11680:1875683630438400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791533.553037:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791533.553071:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98da6540 going to sleep for 11 seconds 00000100:00100000:2.0:1788791533.553119:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630438400 00000100:00100000:2.0:1788791533.553150:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630438400 00000100:00100000:2.0:1788791533.553173:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788791533.553179:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:11680:x1875683630438400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788791533.553326:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:11680:x1875683630438400:12345-0@lo:502:llog_process_th.0 Request processed in 146us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791533.553334:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788791533.553408:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:11680:1875683630438400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788791533.553440:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788791533.553449:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791533.553451:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788791533.553458:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ab9818e0800 00000020:00000080:1.0:1788791533.553461:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788791533.553531:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:11680:1875683630438528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791533.553562:0:11680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791533.553583:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98da6540 going to sleep for 11 seconds 00000100:00100000:3.0:1788791533.555726:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630438528 00000100:00100000:3.0:1788791533.555746:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630438528 00000100:00100000:3.0:1788791533.555806:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788791533.555817:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:11680:x1875683630438528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788791533.556090:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:11680:x1875683630438528:12345-0@lo:502:llog_process_th.0 Request processed in 274us (2526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791533.556099:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788791533.556153:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc008e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:11680:1875683630438528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788791533.556191:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788791533.556199:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791533.556201:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788791533.556206:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788791533.556812:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788791533.556842:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788791533.556853:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322eef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ef6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791533.556864:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ef6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791533.556874:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788791533.556876:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9ababbc61000 from 7 10000000:01000000:3.0:1788791533.556879:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788791533.556912:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c600/0xcd6380150a322efd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791533.556926:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb16c600/0xcd6380150a322efd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791533.556934:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb16c600/0xcd6380150a322efd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791533.556957:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630438656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788791533.556999:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791533.557050:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba857623c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791533.557185:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630438656 00000100:00100000:0.0:1788791533.557191:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630438656 00000100:00100000:0.0:1788791533.557236:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788791533.557246:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:5834:x1875683630438656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788791533.557256:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791533.557271:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994ff400/0xcd6380150a322f04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322efd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791533.557291:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ff400/0xcd6380150a322f04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322efd expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791533.557302:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994ff400/0xcd6380150a322f04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322efd expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791533.557316:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff400, rc 0) 00000100:00100000:0.0:1788791533.557351:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630438656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791533.557357:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788791533.557685:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630438656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791533.557700:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb16c600/0xcd6380150a322efd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322f04 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791533.557719:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb16c600/0xcd6380150a322efd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322f04 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791533.557776:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630438784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791533.557809:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791533.557839:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba857623c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791533.558529:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630438784 00000100:00100000:0.0:1788791533.558535:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630438784 00000100:00100000:0.0:1788791533.558573:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788791533.558581:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630438784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788791533.558850:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630438784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791533.558859:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788791533.559010:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630438784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791533.559062:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630438912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788791533.559102:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791533.559161:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba857623c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791533.559449:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630438912 00000100:00100000:0.0:1788791533.559453:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630438912 00000100:00100000:0.0:1788791533.559490:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788791533.559498:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630438912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788791533.559648:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630438912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791533.559656:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788791533.559697:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630438912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788791533.560074:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:11682:1875683630439040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788791533.560112:0:11682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791533.560174:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba90694000 going to sleep for 11 seconds 00000100:00100000:1.0:1788791533.560325:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630439040 00000100:00100000:1.0:1788791533.560330:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630439040 00000100:00100000:1.0:1788791533.560365:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788791533.560372:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:11682:x1875683630439040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791533.560512:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:11682:x1875683630439040:12345-0@lo:502:llog_process_th.0 Request processed in 139us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791533.560519:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788791533.563173:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:11682:1875683630439040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788791533.563220:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788791533.563233:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791533.563236:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788791533.563242:0:11682:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9ababbc61000 00000020:00000080:2.0:1788791533.563245:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788791533.563346:0:11682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2e0a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:11682:1875683630439168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788791533.563427:0:11682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791533.563469:0:11682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791533.565859:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630439168 00000100:00100000:0.0:1788791533.565873:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630439168 00000100:00100000:0.0:1788791533.565944:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788791533.565954:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:11682:x1875683630439168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788791533.566232:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:11682:x1875683630439168:12345-0@lo:502:llog_process_th.0 Request processed in 279us (2817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791533.566240:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788791533.567116:0:11682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2e0a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:11682:1875683630439168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788791533.567170:0:11682:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788791533.567178:0:11682:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791533.567181:0:11682:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788791533.567185:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788791533.567470:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788791533.567498:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788791533.567528:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c600/0xcd6380150a322efd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322f04 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791533.567538:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb16c600/0xcd6380150a322efd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322f04 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791533.567549:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788791533.567552:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9aba98e4f000 from 7 10000000:01000000:1.0:1788791533.567555:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788791533.567585:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791533.567593:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791533.567613:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791533.567633:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630439296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788791533.567679:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791533.567836:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98da6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788791533.567894:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630439296 00000100:00100000:0.0:1788791533.567900:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630439296 00000100:00100000:0.0:1788791533.567940:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788791533.567949:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:5834:x1875683630439296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788791533.567960:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791533.567972:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994ffe00/0xcd6380150a322f12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a322f0b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791533.567992:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ffe00/0xcd6380150a322f12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a322f0b expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791533.568002:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994ffe00/0xcd6380150a322f12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a322f0b expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791533.568010:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ffe00, rc 0) 00000100:00100000:0.0:1788791533.568067:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630439296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791533.568074:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788791533.569139:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630439296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791533.569159:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322f12 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791533.569181:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322f12 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791533.569241:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2e0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630439424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791533.569285:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791533.569302:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791533.572357:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630439424 00000100:00100000:1.0:1788791533.572372:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630439424 00000100:00100000:1.0:1788791533.572418:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788791533.572428:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630439424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791533.572733:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630439424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791533.572741:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788791533.573104:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2e0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630439424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791533.573172:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2e0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630439552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788791533.573223:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791533.573256:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791533.576050:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630439552 00000100:00100000:1.0:1788791533.576065:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630439552 00000100:00100000:1.0:1788791533.576340:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788791533.576352:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630439552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791533.576715:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:5834:x1875683630439552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 359us (3485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791533.576724:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788791533.577564:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2e0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9967ad2d-016f-4163-8b2b-d5dc380f4403:5834:1875683630439552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788791533.578148:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:11684:1875683630439680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788791533.578223:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791533.578258:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906943c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791533.579553:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630439680 00000100:00100000:3.0:1788791533.579565:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630439680 00000100:00100000:3.0:1788791533.579621:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788791533.579630:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:11684:x1875683630439680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788791533.579876:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:11684:x1875683630439680:12345-0@lo:502:llog_process_th.0 Request processed in 245us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791533.579884:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788791533.579895:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:11684:1875683630439680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788791533.579928:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788791533.579938:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791533.579941:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788791533.579947:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9aba98e4f000 00000020:00000080:1.0:1788791533.579960:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788791533.580060:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc00bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:11684:1875683630439808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791533.580101:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791533.580161:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98da6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788791533.580543:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630439808 00000100:00100000:0.0:1788791533.580549:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630439808 00000100:00100000:0.0:1788791533.580592:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788791533.580600:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:11684:x1875683630439808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788791533.580750:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:11684:x1875683630439808:12345-0@lo:502:llog_process_th.0 Request processed in 150us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791533.580758:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788791533.581073:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc00bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9967ad2d-016f-4163-8b2b-d5dc380f4403:11684:1875683630439808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788791533.581097:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788791533.581103:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791533.581104:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788791533.581109:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788791533.582544:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788791533.582579:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788791533.582591:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322f12 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791533.582602:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322f12 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788791533.598298:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788791533.873304:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791533.873522:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606287872 00000100:00100000:3.0:1788791533.873534:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606287872 00000100:00100000:3.0:1788791533.873623:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 267 00000100:00100000:3.0:1788791533.873634:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba98d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:5597:x1875683606287872:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791533.873651:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791533.873669:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16c200/0xcd6380150a322f19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f83 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791533.873711:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16c200/0xcd6380150a322f19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f83 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791533.873722:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16c200/0xcd6380150a322f19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f83 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791533.873732:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c200, rc 0) 00000100:00100000:3.0:1788791533.873846:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba98d9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:5597:x1875683606287872:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 213us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791533.873854:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 267 00000100:00100000:3.0:1788791533.878561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791533.878773:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606288000 00000100:00100000:1.0:1788791533.878784:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606288000 00000100:00100000:1.0:1788791533.878880:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 268 00000100:00100000:1.0:1788791533.878891:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:5597:x1875683606288000:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791533.879207:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:5597:x1875683606288000:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 316us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791533.879215:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 268 00000100:00100000:3.0:1788791533.882660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791533.897015:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606288128 00000100:00100000:0.0:1788791533.897031:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606288128 00000100:00100000:0.0:1788791533.897100:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 269 00000100:00100000:0.0:1788791533.897110:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:5597:x1875683606288128:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788791533.897364:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:5597:x1875683606288128:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 254us (14715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791533.897372:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 269 00000100:00100000:3.0:1788791533.905983:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791533.906508:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606288256 00000100:00100000:0.0:1788791533.906523:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606288256 00000100:00100000:0.0:1788791533.906794:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 270 00000100:00100000:0.0:1788791533.906808:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:9959:x1875683606288256:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788791533.907549:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:9959:x1875683606288256:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 742us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791533.907559:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 270 00000100:00100000:3.0:1788791533.915398:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791533.915646:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606288384 00000100:00100000:2.0:1788791533.915659:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606288384 00000100:00100000:2.0:1788791533.915730:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 271 00000100:00100000:2.0:1788791533.915742:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:9959:x1875683606288384:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788791533.916103:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:9959:x1875683606288384:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 355us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791533.916113:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 271 00000100:00100000:3.0:1788791533.931512:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791533.931948:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606288512 00000100:00100000:2.0:1788791533.931963:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606288512 00000100:00100000:2.0:1788791533.932042:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 272 00000100:00100000:2.0:1788791533.932055:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:5597:x1875683606288512:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791533.932078:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791533.932102:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abac2170600/0xcd6380150a322f20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f8a expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791533.932183:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abac2170600/0xcd6380150a322f20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f8a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791533.932196:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abac2170600/0xcd6380150a322f20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f8a expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791533.932208:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abac2170600, rc 0) 00000100:00100000:2.0:1788791533.932340:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:5597:x1875683606288512:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 287us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791533.932349:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 272 00000100:00100000:2.0:1788791533.946473:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791533.946820:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606288640 00000100:00100000:0.0:1788791533.946835:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606288640 00000100:00100000:0.0:1788791533.946916:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 273 00000100:00100000:0.0:1788791533.946928:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:5597:x1875683606288640:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788791533.948197:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:5597:x1875683606288640:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 1263us (1732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791533.948212:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 273 00000100:00100000:2.0:1788791533.951893:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791533.951976:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606288768 00000100:00100000:3.0:1788791533.951988:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606288768 00000100:00100000:3.0:1788791533.952099:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 274 00000100:00100000:3.0:1788791533.952112:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:5597:x1875683606288768:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788791533.952457:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:5597:x1875683606288768:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 345us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791533.952465:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 274 00000100:00100000:2.0:1788791533.956760:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791533.956977:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606288896 00000100:00100000:0.0:1788791533.956992:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606288896 00000100:00100000:0.0:1788791533.957075:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 275 00000100:00100000:0.0:1788791533.957088:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:9962:x1875683606288896:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788791533.957482:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:9962:x1875683606288896:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 394us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791533.957492:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 275 00000100:00100000:0.0:1788791533.963174:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791533.963302:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606289024 00000100:00100000:3.0:1788791533.963327:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606289024 00000100:00100000:3.0:1788791533.963391:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 276 00000100:00100000:3.0:1788791533.963405:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:9962:x1875683606289024:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788791533.964104:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:9962:x1875683606289024:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 699us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791533.964116:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 276 00010000:00010000:2.0:1788791534.243484:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788791534.627905:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788791534.884195:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630440192:0@lo:400:kworker.0 00000100:00100000:2.0:1788791534.884584:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc00a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630440064:0@lo:400:kworker.0 00000100:00100000:2.0:1788791534.884620:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791534.884671:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630440576:0@lo:400:kworker.0 00000100:00100000:2.0:1788791534.884692:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791534.884720:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788791534.884726:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc00bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630439936:0@lo:400:kworker.0 00000100:00100000:2.0:1788791534.884750:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791534.884768:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc00a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630440448:0@lo:400:kworker.0 00000100:00100000:2.0:1788791534.884785:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791534.884810:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630440064 00000100:00100000:2.0:1788791534.884817:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630440064 00000100:00100000:2.0:1788791534.884872:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630440448 00000100:00100000:2.0:1788791534.884875:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630440448 00000100:00100000:2.0:1788791534.884901:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788791534.884908:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630440064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791534.884954:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630440064:12345-0@lo:400:kworker.0 Request processed in 46us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791534.884961:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788791534.884975:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788791534.884981:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630440448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791534.885018:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630440448:12345-0@lo:400:kworker.0 Request processed in 38us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791534.885024:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1788791534.885039:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791534.885064:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc00a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630440448:0@lo:400:kworker.0 00000100:00100000:2.0:1788791534.885074:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc00a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630440064:0@lo:400:kworker.0 00000100:00100000:2.0:1788791534.885094:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630439936 00000100:00100000:2.0:1788791534.885097:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630439936 00000100:00100000:2.0:1788791534.885157:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788791534.885163:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630439936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791534.885193:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630439936:12345-0@lo:400:kworker.0 Request processed in 30us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791534.885199:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788791534.885224:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc00bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630439936:0@lo:400:kworker.0 00000100:00100000:1.0:1788791534.885624:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791534.885658:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630440704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791534.885683:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791534.885705:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791534.885710:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc00b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630440320:0@lo:400:kworker.0 00000100:00100000:1.0:1788791534.885731:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791534.885795:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630440704 00000100:00100000:0.0:1788791534.885800:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630440704 00000100:00100000:0.0:1788791534.885846:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788791534.885855:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875683630440704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788791534.885882:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791534.885918:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875683630440704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791534.885936:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788791534.885954:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630440576 00000100:00100000:0.0:1788791534.885958:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630440576 00000100:00100000:0.0:1788791534.885976:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630440320 00000100:00100000:0.0:1788791534.885978:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630440320 00000100:00100000:0.0:1788791534.886007:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788791534.886013:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875683630440576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791534.886045:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1875683630440576:12345-0@lo:400:kworker.0 Request processed in 33us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791534.886051:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788791534.886061:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788791534.886066:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630440320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791534.886087:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630440320:12345-0@lo:400:kworker.0 Request processed in 22us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791534.886092:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788791534.886156:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630440576:0@lo:400:kworker.0 00000100:00080000:1.0:1788791534.886265:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788791534.886269:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788791534.886287:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababc00b800 x1875683630440320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791534.886305:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc00b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630440320:0@lo:400:kworker.0 00000100:00100000:1.0:1788791534.886329:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630440704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791534.886537:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630440192 00000100:00100000:3.0:1788791534.886542:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630440192 00000100:00100000:3.0:1788791534.886595:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788791534.886602:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630440192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791534.886643:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630440192:12345-0@lo:400:kworker.0 Request processed in 41us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791534.886648:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1788791534.886771:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791534.886792:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630440192:0@lo:400:kworker.0 00010000:00010000:0.0:1788791535.267352:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791535.398844:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791535.398869:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630440832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791535.398940:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791535.399280:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630440832 00000100:00100000:2.0:1788791535.399301:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630440832 00000100:00100000:2.0:1788791535.399352:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788791535.399382:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630440832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788791535.399418:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791535.399461:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630440832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791535.399468:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788791535.400072:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb913480 x1875683630440832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791535.400091:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630440832:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788791536.291431:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791537.315527:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788791538.013947:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1788791538.224141:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791538.226038:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791538.226753:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791538.226791:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791538.226828:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606289408 00000100:00100000:2.0:1788791538.226837:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606289408 00000100:00100000:2.0:1788791538.226911:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:2.0:1788791538.226922:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2353:x1875683606289408:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791538.227000:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2353:x1875683606289408:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 81us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791538.227008:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00080000:2.0:1788791538.227029:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788791538.227321:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606289152 00000100:00100000:1.0:1788791538.227327:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606289152 00000100:00100000:1.0:1788791538.227364:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 278 00000100:00100000:1.0:1788791538.227372:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2353:x1875683606289152:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791538.227408:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2353:x1875683606289152:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 37us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791538.227416:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 278 00000100:00100000:0.0:1788791538.229857:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606289280 00000100:00100000:3.0:1788791538.229858:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606289536 00000100:00100000:3.0:1788791538.229870:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606289536 00000100:00100000:0.0:1788791538.229870:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606289280 00000100:00080000:2.0:1788791538.229993:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791538.231016:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 108 00000100:00100000:0.0:1788791538.231035:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28665881-f918-4421-b36a-72ee58aec27e+5:2353:x1875683606289536:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791538.231148:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28665881-f918-4421-b36a-72ee58aec27e+5:2353:x1875683606289536:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 97us (5094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791538.231333:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 109 00000100:00100000:3.0:1788791538.231345:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2353:x1875683606289280:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791538.231377:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2353:x1875683606289280:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 34us (7262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791538.231385:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 109 00000100:00100000:0.0:1788791538.235977:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 108 00010000:00010000:2.0:1788791538.340965:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791539.365267:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791540.003634:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788791540.003659:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630440960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791540.003731:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791540.004098:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630440960 00000100:00100000:0.0:1788791540.004106:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630440960 00000100:00100000:0.0:1788791540.004188:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788791540.004199:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630440960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788791540.004234:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791540.004283:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630440960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791540.004291:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788791540.004329:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788791540.004335:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ababb486300, transno 4294967300 00000100:00100000:0.0:1788791540.004364:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630440960:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788791540.004563:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788791540.005422:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2e0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630441344:0@lo:400:kworker.0 00000100:00100000:2.0:1788791540.005462:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791540.005497:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788791540.005511:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630441216:0@lo:400:kworker.0 00000100:00100000:2.0:1788791540.005535:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791540.005724:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630441344 00000100:00100000:3.0:1788791540.005730:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630441344 00000100:00100000:3.0:1788791540.005781:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630441216 00000100:00100000:3.0:1788791540.005785:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630441216 00000100:00100000:3.0:1788791540.005804:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788791540.005812:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630441344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791540.005859:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630441344:12345-0@lo:400:kworker.0 Request processed in 48us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791540.005867:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788791540.005881:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788791540.005887:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630441216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791540.005926:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630441216:12345-0@lo:400:kworker.0 Request processed in 38us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791540.005931:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788791540.005955:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630441472:0@lo:400:kworker.0 00000100:00100000:3.0:1788791540.005982:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791540.006003:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788791540.006008:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630441088:0@lo:400:kworker.0 00000100:00100000:3.0:1788791540.006033:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791540.006054:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2e08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630441600:0@lo:400:kworker.0 00000100:00100000:3.0:1788791540.006072:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791540.006120:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630441472 00000100:00100000:3.0:1788791540.006124:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630441472 00000100:00100000:3.0:1788791540.006177:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788791540.006185:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630441472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791540.006221:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630441472:12345-0@lo:400:kworker.0 Request processed in 37us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791540.006227:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788791540.006266:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2e08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630441216:0@lo:400:kworker.0 00000100:00100000:3.0:1788791540.006277:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2e0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630441344:0@lo:400:kworker.0 00010000:00080000:3.0:1788791540.006308:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab2e08700 x1875683630441472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791540.006318:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2e08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630441472:0@lo:400:kworker.0 00000100:00100000:3.0:1788791540.006332:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630441600 00000100:00100000:3.0:1788791540.006335:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630441600 00000100:00100000:3.0:1788791540.006553:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788791540.006560:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630441600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791540.006597:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630441600:12345-0@lo:400:kworker.0 Request processed in 38us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791540.006603:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788791540.006629:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2e08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630441600:0@lo:400:kworker.0 00000100:00080000:2.0:1788791540.006781:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788791540.006785:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791540.006929:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630441088 00000100:00100000:0.0:1788791540.006934:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630441088 00000100:00100000:0.0:1788791540.006971:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788791540.006978:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3312:x1875683630441088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791540.007014:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3312:x1875683630441088:12345-0@lo:400:kworker.0 Request processed in 37us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791540.007019:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788791540.007981:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2e09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630441088:0@lo:400:kworker.0 00010000:00010000:2.0:1788791540.387703:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791540.516118:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788791540.516159:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630441728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788791540.516239:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791540.516425:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630441728 00000100:00100000:0.0:1788791540.516433:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630441728 00000100:00100000:0.0:1788791540.516490:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788791540.516675:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630441728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788791540.516715:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791540.516777:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630441728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 276us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791540.516784:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788791540.516869:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb912d80 x1875683630441728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791556 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791540.516888:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630441728:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788791541.411383:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791542.435694:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791543.341474:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791543.341526:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791543.341559:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791543.341594:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791543.341641:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606289792 00000100:00100000:1.0:1788791543.341653:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606289792 00000100:00100000:3.0:1788791543.341679:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606289920 00000100:00100000:3.0:1788791543.341685:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606289920 00000100:00100000:1.0:1788791543.341735:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606290048 00000100:00100000:1.0:1788791543.341740:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606290048 00000100:00100000:3.0:1788791543.341744:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:3.0:1788791543.341756:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2355:x1875683606289920:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791543.341764:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 113 00000100:00100000:1.0:1788791543.341782:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2355:x1875683606289792:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791543.341887:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2355:x1875683606289920:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 133us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791543.341896:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:3.0:1788791543.341921:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 114 00000100:00100000:3.0:1788791543.341929:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606290048:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791543.342013:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606289664 00000100:00100000:0.0:1788791543.342029:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606289664 00000100:00100000:0.0:1788791543.342061:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 280 00000100:00100000:0.0:1788791543.342068:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2355:x1875683606289664:12345-192.168.201.29@tcp:400:kworker.0 00000100:00080000:2.0:1788791543.342156:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788791543.342161:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791543.342400:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2355:x1875683606289792:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 627us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791543.342409:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 113 00000100:00100000:3.0:1788791543.349739:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28665881-f918-4421-b36a-72ee58aec27e+5:2355:x1875683606290048:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 7797us (8131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791543.349755:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 114 00000100:00100000:0.0:1788791543.350775:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2355:x1875683606289664:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 8701us (9317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791543.350786:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 280 00010000:00010000:0.0:1788791543.464696:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791544.484217:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788791544.867850:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788791545.123460:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630441856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791545.123540:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791545.124122:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630441856 00000100:00100000:3.0:1788791545.124149:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630441856 00000100:00100000:3.0:1788791545.124215:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788791545.124224:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630441856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788791545.124258:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791545.124316:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630441856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791545.124323:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788791545.124375:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630441856:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788791545.124460:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788791545.125119:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630442112:0@lo:400:kworker.0 00000100:00100000:0.0:1788791545.125173:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791545.125201:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788791545.125208:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630441984:0@lo:400:kworker.0 00000100:00100000:0.0:1788791545.125237:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791545.125260:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630442496:0@lo:400:kworker.0 00000100:00100000:0.0:1788791545.125281:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791545.125305:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630442240:0@lo:400:kworker.0 00000100:00100000:0.0:1788791545.125327:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791545.125346:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788791545.125352:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630442368:0@lo:400:kworker.0 00000100:00100000:0.0:1788791545.125375:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791545.125402:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630441984 00000100:00100000:0.0:1788791545.125407:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630441984 00000100:00100000:1.0:1788791545.125433:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630442112 00000100:00100000:1.0:1788791545.125438:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630442112 00000100:00100000:0.0:1788791545.125439:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788791545.125445:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630441984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791545.125462:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630442496 00000100:00100000:1.0:1788791545.125465:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630442496 00000100:00100000:0.0:1788791545.125482:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630441984:12345-0@lo:400:kworker.0 Request processed in 37us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791545.125483:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630442240 00000100:00100000:1.0:1788791545.125486:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630442240 00000100:00100000:1.0:1788791545.125499:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788791545.125504:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8625b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630442112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791545.125504:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788791545.125531:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630442368 00000100:00100000:0.0:1788791545.125535:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630442368 00000100:00100000:1.0:1788791545.125548:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8625b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630442112:12345-0@lo:400:kworker.0 Request processed in 44us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791545.125554:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788791545.125559:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788791545.125565:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630442368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791545.125566:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788791545.125571:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630442496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791545.125595:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630442496:12345-0@lo:400:kworker.0 Request processed in 23us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791545.125596:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86258e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630442368:12345-0@lo:400:kworker.0 Request processed in 32us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791545.125601:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788791545.125602:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788791545.125612:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788791545.125618:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630442240:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788791545.125633:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9aba8625bb80 x1875683630442368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791545.125644:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630442240:12345-0@lo:400:kworker.0 Request processed in 28us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791545.125645:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630442368:0@lo:400:kworker.0 00000100:00100000:1.0:1788791545.125650:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788791545.125654:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630442240:0@lo:400:kworker.0 00000100:00080000:1.0:1788791545.125666:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788791545.125670:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791545.125677:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630441984:0@lo:400:kworker.0 00000100:00100000:0.0:1788791545.125685:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630442496:0@lo:400:kworker.0 00000100:00100000:0.0:1788791545.125693:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630442112:0@lo:400:kworker.0 00010000:00010000:0.0:1788791545.508370:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791545.642510:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630442624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791545.642587:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791545.643113:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630442624 00000100:00100000:2.0:1788791545.643122:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630442624 00000100:00100000:2.0:1788791545.643203:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788791545.643215:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8625a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630442624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788791545.643260:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791545.653184:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8625a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630442624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9960us (10585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791545.653218:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788791545.662565:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb912d80 x1875683630442624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791545.662598:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630442624:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788791546.533103:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791547.556253:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791548.461509:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791548.461570:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791548.461663:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606290176 00000100:00100000:0.0:1788791548.461672:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606290176 00000100:00100000:0.0:1788791548.461736:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 282 00000100:00100000:0.0:1788791548.461745:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2355:x1875683606290176:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791548.461848:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2355:x1875683606290176:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 103us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791548.461856:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 282 00000100:00100000:1.0:1788791548.462408:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606290304 00000100:00100000:1.0:1788791548.462413:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606290304 00000100:00100000:1.0:1788791548.462460:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:1.0:1788791548.462468:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2355:x1875683606290304:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791548.462515:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2355:x1875683606290304:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 48us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791548.462522:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00080000:2.0:1788791548.462573:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791548.482059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791548.482112:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791548.482306:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606290432 00000100:00100000:2.0:1788791548.482316:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606290432 00000100:00100000:2.0:1788791548.482385:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:2.0:1788791548.482396:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2351:x1875683606290432:12345-192.168.201.29@tcp:9:kworker.0 00000020:00000080:2.0:1788791548.482427:0:10087:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322e5c 00000100:00080000:2.0:1788791548.482435:0:10087:0:(import.c:65:import_set_state_nolock()) ffff9aba851e0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788791548.482472:0:10087:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788791548.482737:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+2:2351:x1875683606290432:12345-192.168.201.29@tcp:9:kworker.0 Request processed in 342us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791548.482745:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00010000:00010000:2.0:1788791548.482778:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788791548.483358:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788791548.486342:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606290560 00000100:00100000:1.0:1788791548.486356:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606290560 00000100:00100000:1.0:1788791548.486444:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00100000:1.0:1788791548.486455:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28665881-f918-4421-b36a-72ee58aec27e+5:2354:x1875683606290560:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791548.486543:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28665881-f918-4421-b36a-72ee58aec27e+5:2354:x1875683606290560:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 90us (4430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791548.486551:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00080000:3.0:1788791548.489062:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788791548.582214:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791549.604523:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791550.243445:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630442752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791550.243530:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791550.243639:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630443008:0@lo:400:kworker.0 00000100:00100000:2.0:1788791550.243650:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc00a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630443264:0@lo:400:kworker.0 00000100:00100000:2.0:1788791550.243706:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791550.243748:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788791550.243758:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791550.243767:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc00b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630442880:0@lo:400:kworker.0 00000100:00100000:1.0:1788791550.243806:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788791550.243820:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791550.243820:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc00bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630443136:0@lo:400:kworker.0 00000100:00100000:2.0:1788791550.243870:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc00a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630443392:0@lo:400:kworker.0 00000100:00100000:1.0:1788791550.243871:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791550.243925:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791550.244068:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630442752 00000100:00100000:0.0:1788791550.244078:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630442752 00000100:00100000:0.0:1788791550.244157:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788791550.244168:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630442752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788791550.244206:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791550.244251:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630442752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791550.244258:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788791550.244372:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630442752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791550.244415:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630443264 00000100:00100000:2.0:1788791550.244419:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630443264 00000100:00100000:2.0:1788791550.244451:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788791550.244459:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630443264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791550.244496:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630443264:12345-0@lo:400:kworker.0 Request processed in 39us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791550.244503:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788791550.244524:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630442880 00000100:00100000:2.0:1788791550.244527:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630442880 00000100:00100000:2.0:1788791550.244550:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788791550.244556:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630442880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791550.244584:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630442880:12345-0@lo:400:kworker.0 Request processed in 29us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791550.244590:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788791550.244628:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc00b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630442880:0@lo:400:kworker.0 00010000:00080000:2.0:1788791550.244641:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababc00a300 x1875683630443264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791550.244651:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc00a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630443264:0@lo:400:kworker.0 00000100:00100000:1.0:1788791550.245196:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630443008 00000100:00100000:1.0:1788791550.245208:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630443008 00000100:00100000:1.0:1788791550.245274:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630443136 00000100:00100000:1.0:1788791550.245278:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630443136 00000100:00100000:1.0:1788791550.245295:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630443392 00000100:00100000:1.0:1788791550.245298:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630443392 00000100:00100000:1.0:1788791550.245315:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788791550.245323:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630443008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791550.245417:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630443008:12345-0@lo:400:kworker.0 Request processed in 94us (1692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791550.245426:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788791550.245446:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788791550.245452:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630443136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791550.245484:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630443136:12345-0@lo:400:kworker.0 Request processed in 33us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791550.245490:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788791550.245584:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788791550.245591:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630443392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791550.245634:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630443392:12345-0@lo:400:kworker.0 Request processed in 43us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791550.245640:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788791550.245709:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc00bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630443136:0@lo:400:kworker.0 00000100:00100000:1.0:1788791550.245734:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc009180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630443008:0@lo:400:kworker.0 00000100:00100000:1.0:1788791550.245814:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc00a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630443392:0@lo:400:kworker.0 00000100:00080000:1.0:1788791550.245842:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788791550.245848:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788791550.245851:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788791550.630155:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791550.755658:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630443520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791550.755743:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791550.756330:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630443520 00000100:00100000:2.0:1788791550.756340:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630443520 00000100:00100000:2.0:1788791550.756397:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788791550.756406:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc00a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630443520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788791550.756439:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791550.756492:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc00a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630443520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791550.756513:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788791550.756599:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababc137480 x1875683630443520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791566 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791550.756618:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630443520:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788791551.658516:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791552.677345:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788791553.408293:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00000020:00000080:0.0:1788791553.408303:0:7644:0:(genops.c:885:class_export_put()) final put ffff9aba851e3000/aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00000020:00000080:1.0:1788791553.408362:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba851e3000/aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 for lustre-OST0001 00000020:00000080:1.0:1788791553.408413:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9aba851e0000 for lustre-OST0001 00000100:00100000:3.0:1788791553.581804:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791553.581873:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791553.581912:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791553.581947:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606290816 00000100:00100000:3.0:1788791553.581956:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606290816 00000100:00100000:3.0:1788791553.582011:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606290944 00000100:00100000:3.0:1788791553.582014:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606290944 00000100:00100000:3.0:1788791553.582037:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:3.0:1788791553.582046:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2353:x1875683606290816:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791553.582117:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2353:x1875683606290816:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 72us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791553.582157:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:3.0:1788791553.582176:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 124 00000100:00100000:3.0:1788791553.582183:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28665881-f918-4421-b36a-72ee58aec27e+5:2353:x1875683606290944:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791553.582207:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28665881-f918-4421-b36a-72ee58aec27e+5:2353:x1875683606290944:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 25us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791553.582213:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 124 00000100:00080000:3.0:1788791553.582230:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791553.582575:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606290688 00000100:00100000:0.0:1788791553.582580:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606290688 00000100:00100000:0.0:1788791553.582614:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 284 00000100:00100000:0.0:1788791553.582621:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2353:x1875683606290688:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791553.582653:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2353:x1875683606290688:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 33us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791553.582659:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 284 00010000:00010000:2.0:1788791553.699358:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788791554.085180:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788791554.728105:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791555.363595:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630443648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791555.363736:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791555.365803:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630443904:0@lo:400:kworker.0 00000100:00100000:2.0:1788791555.365822:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630444160:0@lo:400:kworker.0 00000100:00100000:3.0:1788791555.365958:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630443648 00000100:00100000:3.0:1788791555.365967:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630443648 00000100:00100000:3.0:1788791555.366034:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788791555.366044:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630443648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788791555.366082:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791555.366182:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791555.366195:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630443648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (2458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791555.366203:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788791555.366227:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788791555.366243:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630443904 00000100:00100000:3.0:1788791555.366261:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630443904 00000100:00100000:3.0:1788791555.366291:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788791555.366298:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630443904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791555.366391:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630443776:0@lo:400:kworker.0 00000100:00100000:0.0:1788791555.366624:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630444032:0@lo:400:kworker.0 00000100:00100000:1.0:1788791555.370586:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791555.370682:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630444288:0@lo:400:kworker.0 00000100:00100000:1.0:1788791555.371106:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791555.371365:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630443776 00000100:00100000:1.0:1788791555.371377:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630443776 00000100:00100000:1.0:1788791555.371465:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788791555.371576:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630443776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791555.371661:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630443776:12345-0@lo:400:kworker.0 Request processed in 89us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791555.371669:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788791555.371747:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630443776:0@lo:400:kworker.0 00000100:00100000:1.0:1788791555.371821:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630444288 00000100:00100000:1.0:1788791555.371826:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630444288 00000100:00100000:1.0:1788791555.372344:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788791555.372357:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630444288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791555.372543:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630444288:12345-0@lo:400:kworker.0 Request processed in 121us (1368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791555.372551:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:1.0:1788791555.372584:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791555.372773:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb701500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630444288:0@lo:400:kworker.0 00000100:00100000:2.0:1788791555.378864:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791555.378958:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630443648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791555.379084:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630444160 00000100:00100000:2.0:1788791555.379092:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630444160 00000100:00100000:2.0:1788791555.379184:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788791555.379193:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630444160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791555.379265:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3083480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630444160:12345-0@lo:400:kworker.0 Request processed in 73us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791555.379272:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788791555.379389:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788791555.379413:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababb701c00 x1875683630444160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788791571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791555.379425:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630444160:0@lo:400:kworker.0 00000100:00100000:3.0:1788791555.383926:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb702d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630443904:12345-0@lo:400:kworker.0 Request processed in 17618us (17792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791555.383952:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788791555.384441:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630443904:0@lo:400:kworker.0 00000100:00100000:1.0:1788791555.387597:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791555.388330:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630444032 00000100:00100000:3.0:1788791555.388344:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630444032 00000100:00100000:3.0:1788791555.388497:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788791555.388511:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc00bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630444032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791555.388617:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc00bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630444032:12345-0@lo:400:kworker.0 Request processed in 109us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791555.388627:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788791555.389855:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630444032:0@lo:400:kworker.0 00000100:00080000:2.0:1788791555.396313:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788791555.748454:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791555.875380:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791555.875404:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630444416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791555.875471:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791555.875692:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630444416 00000100:00100000:3.0:1788791555.875700:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630444416 00000100:00100000:3.0:1788791555.875752:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788791555.875763:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630444416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788791555.875795:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791555.875845:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630444416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791555.875853:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1788791555.875893:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ababc134a80 x1875683630444416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791571 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791555.875911:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630444416:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788791556.165890:0:11847:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 10:32:34 (1788791554) 00010000:00010000:1.0:1788791556.771816:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791557.797673:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791557.895563:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791557.902351:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606291072 00000100:00100000:1.0:1788791557.902375:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606291072 00000100:00080000:2.0:1788791557.902580:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791557.903477:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:1.0:1788791557.903501:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:10233:x1875683606291072:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788791557.903529:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791557.903668:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a322f27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f91 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.903754:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525600/0xcd6380150a322f2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.903768:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525600/0xcd6380150a322f2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.903782:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525600/0xcd6380150a322f2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791557.903980:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788791557.903985:0:8351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791557.904069:0:8351:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525600/0xcd6380150a322f2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.904097:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a322f27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f91 expref: 7 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.904117:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525600/0xcd6380150a322f2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f91 expref: 6 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.904286:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:1.0:1788791557.904289:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788791557.904292:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba81525600, rc 0) 00000100:00100000:0.0:1788791557.904470:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:10233:x1875683606291072:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 978us (8924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791557.904480:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:3.0:1788791557.912944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791557.913744:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606291200 00000100:00100000:1.0:1788791557.913756:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606291200 00000100:00100000:1.0:1788791557.913823:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:1.0:1788791557.913833:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:10234:x1875683606291200:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788791557.913855:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791557.913874:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524600/0xcd6380150a322f35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f98 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.913947:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322f3c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.913961:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322f3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.913972:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322f3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.914007:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a322f43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.914015:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a322f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.914022:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a322f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.914621:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00800/0xcd6380150a322f4a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.914632:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00800/0xcd6380150a322f4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.914640:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00800/0xcd6380150a322f4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791557.914716:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788791557.914720:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791557.914784:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00800/0xcd6380150a322f4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.914796:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322f3c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.914803:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322f3c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.914810:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322f3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.914817:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81525c00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791557.914821:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322f3c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.914828:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322f3c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.914839:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:1.0:1788791557.914847:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791557.914852:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322f3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.914859:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a322f3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.914872:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a322f43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.914878:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a322f43 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.914884:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a322f43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.914889:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01a00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791557.914892:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a322f43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.916285:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a322f43 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.916313:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9ababb052300) 00010000:00010000:1.0:1788791557.916316:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791557.916322:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a322f43 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.916330:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a322f43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.916382:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524600/0xcd6380150a322f35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f98 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.916418:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00800/0xcd6380150a322f4a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f98 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791557.916426:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ababb052400) 00010000:00010000:1.0:1788791557.916428:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788791557.916430:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c00800, rc 0) 00000100:00100000:1.0:1788791557.916552:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc137480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:10234:x1875683606291200:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 2718us (3617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791557.916561:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:1.0:1788791557.922066:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791557.922374:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606291456 00000100:00100000:3.0:1788791557.922385:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606291456 00000100:00100000:3.0:1788791557.922480:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:3.0:1788791557.922494:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc00a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:10234:x1875683606291456:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788791557.922528:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791557.922549:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322f51 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674f9f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.922636:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322f58 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.922650:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322f58 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.922661:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322f58 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.922721:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322f5f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.922729:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322f5f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.922736:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322f5f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.923482:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a322f66 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.923494:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a322f66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.923516:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a322f66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791557.923527:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1788791557.923718:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322f58 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.923726:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322f58 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.923733:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322f58 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.923739:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16cc00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791557.923743:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322f58 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.923751:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322f58 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.923762:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ababb052400) 00010000:00010000:3.0:1788791557.923765:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791557.923769:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322f58 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.923775:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322f58 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.923786:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322f5f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.923792:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322f5f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.923803:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322f5f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.923808:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791557.923811:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322f5f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.923817:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322f5f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.923824:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9aba8823c700) 00010000:00010000:3.0:1788791557.923826:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791557.923829:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322f5f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.923835:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322f5f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.925665:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322f51 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f9f expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.925689:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a322f66 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f9f expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791557.925698:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9aba8823c000) 00010000:00010000:3.0:1788791557.925700:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791557.925703:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d400, rc 0) 00000100:00100000:3.0:1788791557.925785:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc00a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:10234:x1875683606291456:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 3294us (3729us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788791557.925802:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:3.0:1788791557.935402:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791557.935494:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606291584 00000100:00100000:1.0:1788791557.935515:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606291584 00000100:00100000:1.0:1788791557.935710:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:1.0:1788791557.935721:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:10234:x1875683606291584:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788791557.935851:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb787800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:10234:x1875683606291584:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 Request processed in 131us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791557.935858:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000040:00080000:1.0:1788791558.180883:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1788791558.482626:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:3.0:1788791558.704607:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791558.704643:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791558.704680:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791558.704704:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606291712 00000100:00100000:3.0:1788791558.704713:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606291712 00000100:00100000:3.0:1788791558.704759:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 286 00000100:00100000:3.0:1788791558.704769:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2354:x1875683606291712:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791558.704835:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2354:x1875683606291712:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 67us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791558.704842:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 286 00000100:00100000:3.0:1788791558.704874:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606291968 00000100:00100000:3.0:1788791558.704877:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606291968 00000100:00100000:3.0:1788791558.705119:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606291840 00000100:00100000:3.0:1788791558.705150:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606291840 00000100:00080000:2.0:1788791558.708976:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791558.711048:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 128 00000100:00100000:1.0:1788791558.711073:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28665881-f918-4421-b36a-72ee58aec27e+5:2354:x1875683606291968:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791558.711175:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb784700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28665881-f918-4421-b36a-72ee58aec27e+5:2354:x1875683606291968:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 113us (6531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791558.711183:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 128 00000100:00100000:1.0:1788791558.711210:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 129 00000100:00100000:1.0:1788791558.711230:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2354:x1875683606291840:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791558.711258:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb785180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2354:x1875683606291840:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 30us (6578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791558.711264:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 129 00010000:00010000:1.0:1788791558.822784:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791559.856658:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791559.898974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791559.899068:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606292096 00000100:00100000:1.0:1788791559.899079:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606292096 00000100:00100000:1.0:1788791559.899184:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:1.0:1788791559.899195:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:10277:x1875683606292096:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788791559.899216:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791559.899237:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a322f74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674fa6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899297:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a322f7b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899311:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a322f7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899320:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a322f7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899332:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a322f82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899338:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a322f82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899344:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a322f82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899618:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a322f7b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899627:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a322f7b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899634:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a322f7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899639:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791559.899643:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a322f7b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899650:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a322f7b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899662:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:1.0:1788791559.899665:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791559.899670:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a322f7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899676:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a322f7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899686:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a322f82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899691:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a322f82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899697:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a322f82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899706:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791559.899709:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a322f82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899714:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a322f82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899721:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9ababb052300) 00010000:00010000:1.0:1788791559.899723:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791559.899726:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a322f82 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899731:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a322f82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899757:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a322f74 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fa6 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899766:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:1.0:1788791559.899768:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791559.899771:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a322f74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fa6 expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791559.899779:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c00c00, rc 0) 00000100:00100000:1.0:1788791559.899831:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb702680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:10277:x1875683606292096:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 638us (867us total) trans 0 rc 301/301 00000100:00100000:1.0:1788791559.899838:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00080000:2.0:1788791559.900054:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791559.915692:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791559.917073:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606292352 00000100:00100000:3.0:1788791559.917086:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606292352 00000100:00100000:3.0:1788791559.917160:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:3.0:1788791559.917169:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:10277:x1875683606292352:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:3.0:1788791559.917225:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791559.917252:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525600/0xcd6380150a322f2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f91 expref: 8 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.917273:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:3.0:1788791559.917284:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788791559.917585:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322f89 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.917606:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322f89 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.917616:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322f89 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.917628:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a322f90 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.917635:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a322f90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.917641:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a322f90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791559.918593:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1788791559.918605:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322f89 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.918613:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322f89 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.918620:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322f89 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.918626:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791559.918630:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322f89 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.918637:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322f89 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.918657:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:3.0:1788791559.918659:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791559.918663:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322f89 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.918668:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322f89 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788791559.918683:0:5839:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000f66155c0 reply state 00000000560d3daf transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a322f90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791559.918692:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788791559.918811:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:10277:x1875683606292352:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 1638us (3124us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788791559.918820:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00010000:00010000:3.0:1788791559.929040:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a322f90 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.929058:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a322f90 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.929065:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a322f90 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.929071:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791559.929076:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a322f90 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.929084:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a322f90 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.929113:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9aba8823c800) 00010000:00010000:3.0:1788791559.929116:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791559.929121:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a322f90 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791559.929153:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a322f90 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791560.002360:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791560.002416:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606292480 00000100:00100000:0.0:1788791560.002427:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606292480 00000100:00100000:0.0:1788791560.002478:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:0.0:1788791560.002488:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:10285:x1875683606292480:12345-192.168.201.29@tcp:101:lctl.0 00010000:00010000:0.0:1788791560.002512:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791560.002535:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a322f97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674fad expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.002805:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a322f9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.002819:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a322f9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.002830:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a322f9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791560.002895:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788791560.002899:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791560.002940:0:5836:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a322f9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.002964:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a322f97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fad expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.002980:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a322f9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fad expref: 9 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.002988:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba94530100) 00010000:00010000:0.0:1788791560.002991:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788791560.002994:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ffa00, rc 0) 00000100:00100000:0.0:1788791560.003412:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb700a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:10285:x1875683606292480:12345-192.168.201.29@tcp:101:lctl.0 Request processed in 923us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791560.003420:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:1.0:1788791560.061901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791560.062025:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606292608 00000100:00100000:3.0:1788791560.062036:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606292608 00000100:00100000:3.0:1788791560.062086:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:3.0:1788791560.062096:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc00b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:10291:x1875683606292608:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1788791560.062116:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791560.062158:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a322fa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674fb4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062225:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322fac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062235:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322fac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062243:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322fac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062252:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322fb3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062256:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062266:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062371:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322fba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062379:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322fba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062387:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322fba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791560.062418:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1788791560.062422:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788791560.062466:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322fba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062479:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322fac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062485:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322fac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062491:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322fac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062497:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791560.062502:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322fac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062508:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322fac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062527:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba94530100) 00010000:00010000:3.0:1788791560.062530:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791560.062535:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322fac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062541:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a322fac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062567:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062573:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322fb3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062578:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062583:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791560.062586:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062600:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322fb3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062609:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9aba8823c800) 00010000:00010000:3.0:1788791560.062612:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791560.062614:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322fb3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062620:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a322fb3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062661:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a322fa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fb4 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062676:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322fba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fb4 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.062683:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:3.0:1788791560.062685:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788791560.062687:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16cc00, rc 0) 00000100:00100000:3.0:1788791560.062744:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc00b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:10291:x1875683606292608:12345-192.168.201.29@tcp:101:bash.0 Request processed in 649us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791560.062751:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:3.0:1788791560.068362:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791560.068434:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606292864 00000100:00100000:0.0:1788791560.068445:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606292864 00000100:00100000:0.0:1788791560.069108:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:0.0:1788791560.069122:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:10291:x1875683606292864:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1788791560.069168:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791560.069187:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a322fc1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674fbb expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.069330:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322fc8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.069363:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322fc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.069375:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322fc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.069435:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a322fcf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.069442:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a322fcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.069448:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a322fcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788791560.069994:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1788791560.070195:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a322fd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.070206:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a322fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.070214:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a322fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.070241:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322fc8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.070248:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322fc8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.070255:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322fc8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.070267:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fea00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791560.070272:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322fc8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.070279:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322fc8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.070291:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:0.0:1788791560.070294:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791560.070298:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322fc8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.070303:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a322fc8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788791560.070315:0:5836:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000aee6c43e reply state 00000000408f32b4 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a322fcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791560.070323:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788791560.070352:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a322fc1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fbb expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.070365:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a322fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fbb expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.070388:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba94530b00) 00010000:00010000:0.0:1788791560.070390:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788791560.070392:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe200, rc 0) 00000100:00100000:0.0:1788791560.070451:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb787100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:10291:x1875683606292864:12345-192.168.201.29@tcp:101:bash.0 Request processed in 1333us (2098us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788791560.070463:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00010000:00010000:3.0:1788791560.075718:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a322fcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.075736:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a322fcf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.075744:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a322fcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.075751:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ffc00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791560.075756:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a322fcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.075764:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a322fcf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.075801:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba94530900) 00010000:00010000:3.0:1788791560.075804:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791560.075809:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a322fcf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.075816:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a322fcf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791560.083738:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791560.084148:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606292992 00000100:00100000:2.0:1788791560.084159:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606292992 00000100:00100000:0.0:1788791560.084415:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1788791560.084424:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1875683606292992:12345-192.168.201.29@tcp:8:bash.0 00010000:00080000:0.0:1788791560.084457:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp t0 exp 0000000000000000 cur 336 last 0 00000020:00000080:0.0:1788791560.084487:0:6681:0:(genops.c:1385:class_connect()) connect: client aafa64f5-7c0a-45ff-aeda-f3a6deb3b804, cookie 0xcd6380150a322fe4 00002000:00100000:0.0:1788791560.084499:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli aafa64f5-7c0a-45ff-aeda-f3a6deb3b804/ffff9abab7a73800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788791560.084523:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788791560.084759:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788791560.084791:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9abab7a72000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788791560.085105:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2351:x1875683606292992:12345-192.168.201.29@tcp:8:bash.0 Request processed in 679us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791560.085115:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1788791560.091873:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791560.091958:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606293120 00000100:00100000:2.0:1788791560.091968:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606293120 00000100:00100000:2.0:1788791560.092049:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:2.0:1788791560.092061:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:0:x1875683606293120:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788791560.092079:0:10087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788791560.092086:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788791560.092103:0:10087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a322feb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674fc2 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788791560.092164:0:10087:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788791560.092184:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:2.0:1788791560.092189:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791560.092198:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a322feb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc2 expref: 7 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.092220:0:10087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a322feb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc2 expref: 7 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.092233:0:10087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abac2171e00, rc 0) 00000100:00100000:2.0:1788791560.092346:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb702a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:0:x1875683606293120:12345-192.168.201.29@tcp:101:bash.0 Request processed in 287us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791560.092353:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:1.0:1788791560.099469:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791560.099662:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606293248 00000100:00100000:0.0:1788791560.099673:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606293248 00000100:00100000:0.0:1788791560.099735:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:0.0:1788791560.099747:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:10291:x1875683606293248:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1788791560.099766:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791560.099787:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a322ff2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674fc9 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.099817:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a322feb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc2 expref: 8 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.099844:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791560.099849:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791560.099856:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a322ff2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc9 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.100373:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a322feb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc2 expref: 8 pid: 10087 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.100390:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a322feb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc2 expref: 8 pid: 10087 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791560.100403:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb701c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1875683630444544:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791560.100541:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababab3a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791560.108540:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791560.108650:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606293376 00000100:00100000:1.0:1788791560.108659:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606293376 00010000:00010000:1.0:1788791560.108697:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a322feb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc2 expref: 9 pid: 10087 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791560.108735:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:1.0:1788791560.108744:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb701500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2355:x1875683606293376:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791560.108759:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791560.108780:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a322feb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc2 expref: 9 pid: 10087 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791560.108795:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a322feb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc2 expref: 9 pid: 10087 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791560.108820:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791560.108824:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791560.108833:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a322ff2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc9 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791560.108843:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a322ff2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc9 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791560.108886:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a322ff2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc9 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791560.108899:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5823:1875683630444672:192.168.201.29@tcp:105: 00000100:00100000:1.0:1788791560.108998:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab78da000 going to sleep for 11 seconds 00010000:00010000:2.0:1788791560.109773:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a322feb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc2 expref: 9 pid: 10087 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791560.109805:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb701c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1875683630444544:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791560.111101:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a322ff2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc9 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.111123:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fea00, rc 0) 00000100:00100000:2.0:1788791560.111215:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:10291:x1875683606293248:12345-192.168.201.29@tcp:101:bash.0 Request processed in 11469us (11756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791560.111224:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:1.0:1788791560.112983:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5823:1875683630444672:192.168.201.29@tcp:105: 00010000:00010000:1.0:1788791560.113005:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791560.113049:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb701500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2355:x1875683606293376:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 4305us (4518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791560.113059:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:3.0:1788791560.114334:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791560.114496:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606293632 00000100:00100000:2.0:1788791560.114506:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606293632 00000100:00100000:2.0:1788791560.114565:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:2.0:1788791560.114575:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+12:10291:x1875683606293632:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:2.0:1788791560.114966:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:10291:x1875683606293632:12345-192.168.201.29@tcp:35:bash.0 Request processed in 391us (635us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788791560.114974:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:2.0:1788791560.242513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791560.242625:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606293888 00000100:00100000:0.0:1788791560.242637:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606293888 00000100:00100000:0.0:1788791560.242707:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:0.0:1788791560.242719:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:10301:x1875683606293888:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791560.242745:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791560.242767:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a322ff9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674fd0 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791560.242883:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1788791560.243003:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a322ff9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fd0 expref: 15 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.243035:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba94530100) 00010000:00010000:0.0:1788791560.243038:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788791560.243043:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a322ff9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fd0 expref: 15 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.243057:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff600, rc 0) 00000100:00100000:0.0:1788791560.243123:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3081c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:10301:x1875683606293888:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 405us (619us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1788791560.243186:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:1.0:1788791560.249012:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791560.249182:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606294144 00000100:00100000:2.0:1788791560.249193:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606294144 00000100:00100000:2.0:1788791560.249275:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:2.0:1788791560.249285:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:10301:x1875683606294144:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788791560.249537:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+15:10301:x1875683606294144:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 253us (540us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788791560.249545:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1788791560.328750:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791560.329482:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606294272 00000100:00100000:2.0:1788791560.329494:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606294272 00000100:00100000:2.0:1788791560.329573:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:2.0:1788791560.329584:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+15:10308:x1875683606294272:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791560.329610:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791560.329632:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171e00/0xcd6380150a323007 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674fd7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.329708:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171200/0xcd6380150a32300e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.329721:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171200/0xcd6380150a32300e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.329733:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171200/0xcd6380150a32300e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791560.329793:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1788791560.329797:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1788791560.329818:0:5837:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171200/0xcd6380150a32300e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.329844:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171e00/0xcd6380150a323007 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fd7 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.330109:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171200/0xcd6380150a32300e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fd7 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.330119:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:2.0:1788791560.330122:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788791560.330190:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abac2171200, rc 0) 00000100:00100000:2.0:1788791560.330328:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb786a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+16:10308:x1875683606294272:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 745us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791560.330336:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:0.0:1788791560.339524:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791560.339684:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606294528 00000100:00100000:3.0:1788791560.339694:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606294528 00000100:00100000:3.0:1788791560.339759:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:3.0:1788791560.339770:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+16:10308:x1875683606294528:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788791560.339790:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791560.339810:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323015 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674fde expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.340616:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32301c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.340636:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32301c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.340648:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32301c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791560.340659:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788791560.340810:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323015 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fde expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.340830:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32301c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fde expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.340838:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba94530b00) 00010000:00010000:3.0:1788791560.340841:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788791560.340844:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c400, rc 0) 00000100:00100000:3.0:1788791560.341109:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb701c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:10308:x1875683606294528:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1340us (1605us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788791560.341122:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:3.0:1788791560.345834:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791560.346538:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606294784 00000100:00100000:0.0:1788791560.346557:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606294784 00000100:00100000:0.0:1788791560.346668:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:0.0:1788791560.346679:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:10308:x1875683606294784:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791560.346702:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791560.346722:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a32302a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674fe5 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.346811:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323031 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.346824:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.346834:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791560.346866:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788791560.346979:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a32302a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fe5 expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.346995:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323031 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fe5 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791560.347003:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba94530b00) 00010000:00010000:0.0:1788791560.347006:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788791560.347010:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff200, rc 0) 00000100:00100000:0.0:1788791560.347069:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+20:10308:x1875683606294784:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 392us (1245us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788791560.347076:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:3.0:1788791560.347184:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791560.347257:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606294912 00000100:00100000:3.0:1788791560.347262:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606294912 00000100:00100000:3.0:1788791560.347295:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:3.0:1788791560.347302:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+20:2352:x1875683606294912:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791560.347311:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791560.347327:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32301c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fde expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.347341:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba94530b00) 00010000:00010000:3.0:1788791560.347344:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791560.347367:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+19:2352:x1875683606294912:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 65us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791560.347374:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:3.0:1788791560.351577:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791560.351673:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606295040 00000100:00100000:2.0:1788791560.351682:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606295040 00000100:00100000:2.0:1788791560.351738:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:2.0:1788791560.351749:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2355:x1875683606295040:12345-192.168.201.29@tcp:1:lfs.0 00010000:00010000:2.0:1788791560.351793:0:10087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a32303f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.351812:0:10087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a322ff2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc9 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.351819:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791560.351823:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788791560.351827:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a32303f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.351872:0:10087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a322ff2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc9 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.351885:0:10087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a322ff2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc9 expref: 7 pid: 6681 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791560.351899:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3082680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10087:1875683630444800:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788791560.351975:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba83055300 going to sleep for 11 seconds 00000100:00100000:3.0:1788791560.353470:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3082680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10087:1875683630444800:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791560.353493:0:10087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a32303f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791560.354628:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791560.354839:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606295168 00000100:00100000:2.0:1788791560.354848:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606295168 00002000:00100000:2.0:1788791560.354901:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9ababbfd9180 x1875683606295168/t0(0) o4->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:271/0 lens 504/0 e 0 to 0 dl 1788791571 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788791560.354911:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ababbfd9180 with x1875683606295168 ext(0->12) 00010000:00010000:2.0:1788791560.354918:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a322ff2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc9 expref: 8 pid: 6681 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.354933:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a322ff2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc9 expref: 8 pid: 6681 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788791560.354941:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ababbfd9180 00000100:00100000:2.0:1788791560.354975:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1788791560.354985:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2354:x1875683606295168:12345-192.168.201.29@tcp:4:lfs.0 00000001:00100000:3.0:1788791560.389826:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00000100:00100000:2.0:1788791560.390568:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2354:x1875683606295168:12345-192.168.201.29@tcp:4:lfs.0 Request processed in 35578us (35936us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788791560.390581:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00002000:00100000:2.0:1788791560.390595:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9ababbfd9180 x1875683606295168/t4294967299(0) o4->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:271/0 lens 504/448 e 0 to 0 dl 1788791571 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788791560.390604:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ababbfd9180 with x1875683606295168 ext(0->12) 00010000:00010000:2.0:1788791560.390614:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a322ff2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc9 expref: 9 pid: 6681 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.390631:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a322ff2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc9 expref: 9 pid: 6681 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788791560.390656:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ababbfd9180 00000100:00100000:0.0:1788791560.403418:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791560.403885:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606295296 00000100:00100000:2.0:1788791560.403896:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606295296 00010000:00010000:2.0:1788791560.403938:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a322ff2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc9 expref: 9 pid: 6681 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791560.403983:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:2.0:1788791560.403994:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb486300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2355:x1875683606295296:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791560.404009:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788791560.404030:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788791560.404033:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788791560 00002000:00010000:2.0:1788791560.404035:0:5824:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788791560 00002000:00010000:2.0:1788791560.404038:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788791560 00010000:00010000:2.0:1788791560.404044:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a322ff2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc9 expref: 9 pid: 6681 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.404059:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a322ff2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc9 expref: 9 pid: 6681 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.404083:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a322ff2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fc9 expref: 9 pid: 6681 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.404099:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788791560.404104:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788791560.404109:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a32303f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.404163:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a32303f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.404193:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791560.404242:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb486300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2355:x1875683606295296:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 250us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791560.404250:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00010000:00010000:3.0:1788791560.405033:0:10087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a32303f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.405045:0:10087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a32303f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.405073:0:10087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a32303f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.405081:0:10087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a32303f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.405088:0:10087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a32303f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.405095:0:10087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abac2171e00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791560.405099:0:10087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a32303f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.405235:0:10087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a32303f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.405253:0:10087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a32303f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.405261:0:10087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002729422e/0xcd6380150a32303f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791560.405329:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2355:x1875683606295040:12345-192.168.201.29@tcp:1:lfs.0 Request processed in 53581us (53759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791560.405338:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:2.0:1788791560.412694:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791560.412765:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606295552 00000100:00100000:3.0:1788791560.412776:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606295552 00000100:00100000:3.0:1788791560.412832:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1788791560.412843:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+19:10308:x1875683606295552:12345-192.168.201.29@tcp:35:lfs.0 00000004:00010000:3.0:1788791560.412912:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323031 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fe5 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788791560.413212:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1788791560.413267:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1788791560.413863:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1788791560.413919:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323046 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.413934:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a322fd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fbb expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.413949:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323046 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.413988:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a322fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fbb expref: 23 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.414005:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a322fd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fbb expref: 23 pid: 5836 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791560.414019:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85781500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875683630444928:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788791560.414259:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbcc7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788791560.426003:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85781500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875683630444928:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791560.426035:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323046 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791560.433590:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791560.433685:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606295680 00000100:00100000:3.0:1788791560.433694:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606295680 00010000:00010000:3.0:1788791560.433735:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a322fd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fbb expref: 24 pid: 5836 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791560.433781:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:3.0:1788791560.433791:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3081f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+24:2354:x1875683606295680:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791560.433806:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791560.433814:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a322fd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fbb expref: 24 pid: 5836 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.433846:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a322fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fbb expref: 24 pid: 5836 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.433868:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a322fd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fbb expref: 24 pid: 5836 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.433883:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba94530b00) 00010000:00010000:3.0:1788791560.433888:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323046 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.433897:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323046 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.433904:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323046 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.433936:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791560.433988:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3081f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+23:2354:x1875683606295680:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 198us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791560.433996:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00010000:00010000:2.0:1788791560.434665:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323046 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.434676:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323046 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788791560.434792:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788791560.434994:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788791560.435117:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875683630445056:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788791560.435221:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791560.435253:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8665af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791560.435471:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630445056 00000100:00100000:3.0:1788791560.435478:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630445056 00000100:00080000:2.0:1788791560.435608:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788791560.435677:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788791560.435689:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875683630445056:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788791560.435766:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3080000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875683630445056:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 81us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791560.435773:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791560.435842:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875683630445056:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788791560.436457:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788791560.436515:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875683630445184:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788791560.436565:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791560.436938:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba812eda80 going to sleep for 11 seconds 00000100:00100000:1.0:1788791560.437040:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630445184 00000100:00100000:1.0:1788791560.437046:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630445184 00000100:00100000:1.0:1788791560.437076:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788791560.437084:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875683630445184:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788791560.437523:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3082300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875683630445184:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 439us (957us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788791560.437531:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788791560.437686:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875683630445184:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788791560.437738:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788791560.437776:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323046 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.437785:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323046 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.437793:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323046 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.437799:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791560.437803:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323046 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.437811:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323046 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.437825:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba94530b00) 00010000:00010000:2.0:1788791560.437827:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788791560.437832:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323046 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.437838:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323046 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788791560.437997:0:5841:0:(mdd_object.c:4131:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788791560.438312:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788791560.438517:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336818196037ns, next at 337818193642ns, rc = 0 00000001:00080000:2.0:1788791560.438527:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788791560.438635:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba94530b00) 00010000:00010000:2.0:1788791560.438647:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788791560.438653:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323031 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fe5 expref: 27 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791560.438932:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+26:10308:x1875683606295552:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 26090us (26245us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788791560.438941:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000020:00080000:2.0:1788791560.438946:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788791560.443073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791560.443283:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606295808 00000100:00100000:3.0:1788791560.443292:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606295808 00000100:00100000:3.0:1788791560.443451:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:3.0:1788791560.443461:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+26:10308:x1875683606295808:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788791560.443483:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791560.443504:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32304d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674fec expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.443628:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32304d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fec expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.443643:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32304d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fec expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.443663:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:3.0:1788791560.443667:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788791560.443670:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d000, rc 0) 00000100:00100000:3.0:1788791560.443728:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3082a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+27:10308:x1875683606295808:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 269us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791560.443735:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:2.0:1788791560.454524:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791560.454937:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606296064 00000100:00100000:3.0:1788791560.454947:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606296064 00000100:00100000:3.0:1788791560.455004:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1788791560.455015:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba9921f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+27:10308:x1875683606296064:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788791560.455672:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba9921f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+28:10308:x1875683606296064:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 656us (1154us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788791560.455681:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:2.0:1788791560.483917:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630445568:0@lo:400:kworker.0 00000100:00100000:2.0:1788791560.483985:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791560.484023:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791560.484029:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630445696:0@lo:400:kworker.0 00000100:00100000:2.0:1788791560.484051:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791560.484082:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630445568 00000100:00100000:2.0:1788791560.484090:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630445568 00000100:00100000:2.0:1788791560.484159:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630445696 00000100:00100000:2.0:1788791560.484163:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630445696 00000100:00100000:2.0:1788791560.484192:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788791560.484201:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630445568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791560.484248:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3080700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630445568:12345-0@lo:400:kworker.0 Request processed in 47us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791560.484255:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788791560.484285:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788791560.484290:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630445696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791560.484316:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3080a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630445696:12345-0@lo:400:kworker.0 Request processed in 27us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791560.484322:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1788791560.484343:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791560.484369:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630445696:0@lo:400:kworker.0 00000100:00100000:2.0:1788791560.484379:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630445568:0@lo:400:kworker.0 00000100:00100000:3.0:1788791560.484747:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630445440:0@lo:400:kworker.0 00000100:00100000:3.0:1788791560.484781:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791560.484819:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630445952:0@lo:400:kworker.0 00000100:00100000:3.0:1788791560.484852:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791560.484879:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788791560.484885:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630445312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791560.484905:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791560.484919:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630445824:0@lo:400:kworker.0 00000100:00100000:3.0:1788791560.484937:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791560.484961:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630445312 00000100:00100000:3.0:1788791560.484965:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630445312 00000100:00100000:3.0:1788791560.484998:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788791560.485004:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630445312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788791560.485033:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791560.485067:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630445312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791560.485073:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1788791560.485090:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788791560.485098:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630445952 00000100:00100000:3.0:1788791560.485102:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630445952 00000100:00100000:3.0:1788791560.485159:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788791560.485166:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630445952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791560.485196:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630445952:12345-0@lo:400:kworker.0 Request processed in 31us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791560.485202:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788791560.485230:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb487100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630445312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791560.485238:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3083800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630445952:0@lo:400:kworker.0 00000100:00100000:3.0:1788791560.485256:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630445824 00000100:00100000:3.0:1788791560.485260:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630445824 00000100:00100000:3.0:1788791560.485294:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788791560.485300:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630445824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791560.485332:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630445824:12345-0@lo:400:kworker.0 Request processed in 32us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791560.485338:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1788791560.485354:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791560.485369:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3080e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630445824:0@lo:400:kworker.0 00000100:00100000:2.0:1788791560.487293:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630445440 00000100:00100000:2.0:1788791560.487306:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630445440 00000100:00100000:2.0:1788791560.487372:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788791560.487383:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630445440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791560.487469:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630445440:12345-0@lo:400:kworker.0 Request processed in 88us (2686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791560.487476:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788791560.487630:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630445440:0@lo:400:kworker.0 00000100:00100000:1.0:1788791560.561239:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791560.561357:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606296320 00000100:00100000:2.0:1788791560.561368:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606296320 00000100:00100000:2.0:1788791560.561434:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:2.0:1788791560.561445:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+28:10318:x1875683606296320:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791560.561473:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791560.561496:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170400/0xcd6380150a323054 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674ff3 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791560.561617:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788791560.561753:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170400/0xcd6380150a323054 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ff3 expref: 30 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.561786:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba94530100) 00010000:00010000:2.0:1788791560.561789:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788791560.561794:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170400/0xcd6380150a323054 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ff3 expref: 30 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.561809:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abac2170400, rc 0) 00000100:00100000:2.0:1788791560.562051:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+29:10318:x1875683606296320:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 607us (820us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788791560.562059:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:0.0:1788791560.572586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791560.574953:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606296448 00000100:00100000:3.0:1788791560.574969:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606296448 00000100:00100000:3.0:1788791560.575234:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:3.0:1788791560.575245:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+29:10318:x1875683606296448:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:3.0:1788791560.575317:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323062 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575333:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575343:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575355:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323069 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575361:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575368:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575457:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575477:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575485:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788791560.575523:0:5837:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575534:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575539:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323062 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575557:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575563:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791560.575567:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575573:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323062 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575583:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:3.0:1788791560.575586:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791560.575590:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323062 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575596:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323062 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575614:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575620:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323069 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575626:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575630:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16de00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791560.575632:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575638:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323069 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575644:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba8823ca00) 00010000:00010000:3.0:1788791560.575646:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791560.575648:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323069 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575653:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323069 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575665:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575671:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323070 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575677:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575685:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791560.575688:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575815:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323070 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575823:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:3.0:1788791560.575825:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791560.575828:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323070 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.575834:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791560.575919:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+29:10318:x1875683606296448:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 675us (3342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791560.575929:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:0.0:1788791560.578789:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791560.578968:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606296704 00000100:00100000:2.0:1788791560.578979:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606296704 00000100:00100000:2.0:1788791560.579060:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1788791560.579072:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+29:10318:x1875683606296704:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788791560.579370:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+30:10318:x1875683606296704:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 299us (590us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788791560.579379:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:1.0:1788791560.634952:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791560.635416:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606296960 00000100:00100000:2.0:1788791560.635427:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606296960 00000100:00100000:2.0:1788791560.635491:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:2.0:1788791560.635503:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+30:10321:x1875683606296960:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791560.635528:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791560.635559:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170400/0xcd6380150a323077 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453674ffa expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.635651:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171e00/0xcd6380150a32307e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.635679:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171e00/0xcd6380150a32307e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.635695:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171e00/0xcd6380150a32307e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.635711:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170c00/0xcd6380150a323085 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.635718:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170c00/0xcd6380150a323085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.635725:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170c00/0xcd6380150a323085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.635877:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32308c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.635886:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32308c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.635893:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32308c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791560.635904:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788791560.636007:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171e00/0xcd6380150a32307e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.636016:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171e00/0xcd6380150a32307e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.636023:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171e00/0xcd6380150a32307e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.636034:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abac2171e00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791560.636038:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171e00/0xcd6380150a32307e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.636279:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171e00/0xcd6380150a32307e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.636292:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:2.0:1788791560.636295:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791560.636300:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171e00/0xcd6380150a32307e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.636307:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171e00/0xcd6380150a32307e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.636322:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170c00/0xcd6380150a323085 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.636328:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170c00/0xcd6380150a323085 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.636334:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170c00/0xcd6380150a323085 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.636340:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abac2170c00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791560.636342:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170c00/0xcd6380150a323085 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.636349:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170c00/0xcd6380150a323085 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.636368:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba8533fd00) 00010000:00010000:2.0:1788791560.636371:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791560.636374:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170c00/0xcd6380150a323085 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.636380:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170c00/0xcd6380150a323085 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.636429:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2170400/0xcd6380150a323077 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ffa expref: 33 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.636442:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32308c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ffa expref: 32 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.636449:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:2.0:1788791560.636451:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788791560.636454:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81b200, rc 0) 00000100:00100000:2.0:1788791560.636604:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99366d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+32:10321:x1875683606296960:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1103us (1662us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788791560.636613:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:0.0:1788791560.642033:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791560.642124:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606297088 00000100:00100000:2.0:1788791560.642155:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606297088 00000100:00100000:2.0:1788791560.642221:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:2.0:1788791560.642232:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+32:10321:x1875683606297088:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:2.0:1788791560.642326:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a32309a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.642343:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a32309a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.642361:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a32309a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.642388:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a32309a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.642395:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a32309a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.642402:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a32309a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.642408:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b800 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791560.642412:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a32309a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.642419:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a32309a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.642430:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:2.0:1788791560.642433:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788791560.642438:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a32309a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.642444:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a32309a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791560.642523:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+32:10321:x1875683606297088:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 292us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791560.642531:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:0.0:1788791560.644660:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791560.644988:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606297344 00000100:00100000:2.0:1788791560.645010:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606297344 00000100:00100000:2.0:1788791560.645068:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:2.0:1788791560.645078:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+32:10321:x1875683606297344:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788791560.645549:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+33:10321:x1875683606297344:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 462us (887us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788791560.645558:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00010000:00010000:1.0:1788791560.868251:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791560.879747:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791560.881315:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606297600 00000100:00100000:3.0:1788791560.881330:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606297600 00000100:00100000:3.0:1788791560.881423:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:3.0:1788791560.881435:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+33:10352:x1875683606297600:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:3.0:1788791560.881460:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791560.881483:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3230a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675001 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.881585:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3230a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.881616:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3230a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.881626:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3230a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791560.881639:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788791560.881999:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3230a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675001 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.882019:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3230a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675001 expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.882028:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:3.0:1788791560.882031:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788791560.882034:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16de00, rc 0) 00000100:00100000:3.0:1788791560.882106:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+35:10352:x1875683606297600:12345-192.168.201.29@tcp:101:cat.0 Request processed in 673us (2368us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788791560.882113:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:0.0:1788791560.889038:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791560.889091:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791560.889626:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606297984 00000100:00100000:3.0:1788791560.889638:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606297984 00000100:00100000:3.0:1788791560.889699:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:3.0:1788791560.889710:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+35:10352:x1875683606297984:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:3.0:1788791560.889984:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+36:10352:x1875683606297984:12345-192.168.201.29@tcp:35:cat.0 Request processed in 274us (891us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788791560.889992:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1788791560.893225:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606297728 00000100:00100000:2.0:1788791560.893243:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606297728 00000100:00100000:2.0:1788791560.893344:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:2.0:1788791560.893355:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa001e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+36:2354:x1875683606297728:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791560.893380:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791560.893406:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3230a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675001 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.893695:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:2.0:1788791560.893701:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791560.893769:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa001e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+35:2354:x1875683606297728:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 415us (4743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791560.893777:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:0.0:1788791560.957297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791560.957465:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606298240 00000100:00100000:2.0:1788791560.957476:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606298240 00000100:00100000:2.0:1788791560.957569:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:2.0:1788791560.957580:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+35:10358:x1875683606298240:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:2.0:1788791560.957605:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791560.957608:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788791560.957634:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abac2171200/0xcd6380150a32300e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fd7 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.957666:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:2.0:1788791560.957671:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788791560.957684:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a3230b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675008 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.957785:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.957799:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32308c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ffa expref: 35 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.957808:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230bd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.957840:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32308c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ffa expref: 35 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.957864:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32308c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ffa expref: 35 pid: 8351 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791560.957878:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630446080:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788791560.957968:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba891d2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788791560.964173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791560.964488:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606298368 00000100:00100000:1.0:1788791560.964497:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606298368 00010000:00010000:1.0:1788791560.964545:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32308c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ffa expref: 36 pid: 8351 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791560.964589:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:1.0:1788791560.964600:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+36:2353:x1875683606298368:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791560.964631:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791560.964638:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32308c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ffa expref: 36 pid: 8351 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791560.964651:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32308c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ffa expref: 36 pid: 8351 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791560.964672:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:1.0:1788791560.964677:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791560.964686:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791560.964693:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230bd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791560.964722:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791560.964771:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3081880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+36:2353:x1875683606298368:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 172us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791560.964779:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00010000:00010000:3.0:1788791560.965165:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32308c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ffa expref: 35 pid: 8351 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791560.965195:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630446080:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791560.965216:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.965225:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.965231:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791560.965250:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788791560.965427:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a3230b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675008 expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.965442:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675008 expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.965450:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:3.0:1788791560.965453:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788791560.965455:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81b400, rc 0) 00000100:00100000:3.0:1788791560.965483:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+35:10358:x1875683606298240:12345-192.168.201.29@tcp:101:dd.0 Request processed in 7906us (8209us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788791560.965491:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:1.0:1788791560.969353:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791560.969579:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606298624 00000100:00100000:2.0:1788791560.969590:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606298624 00000100:00100000:2.0:1788791560.969653:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:2.0:1788791560.969664:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+35:10358:x1875683606298624:12345-192.168.201.29@tcp:36:dd.0 00010000:00010000:2.0:1788791560.969995:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3230cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.970013:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3230cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791560.970025:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3230cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788791560.970079:0:8351:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788791560.970104:0:8351:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000009364aeb0 reply state 000000003485bb42 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3230cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791560.970113:0:8351:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788791560.970246:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+38:10358:x1875683606298624:12345-192.168.201.29@tcp:36:dd.0 Request processed in 584us (901us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788791560.970253:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00000020:00080000:2.0:1788791560.970258:0:8351:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788791560.972173:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3230cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.972189:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3230cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.972210:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3230cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.972216:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791560.972222:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3230cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.972229:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3230cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.972244:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:3.0:1788791560.972247:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791560.972252:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3230cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791560.972258:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3230cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791560.997764:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788791560.997792:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba99366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630446208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788791560.997967:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791560.998652:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630446208 00000100:00100000:3.0:1788791560.998662:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630446208 00000100:00100000:3.0:1788791560.998728:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788791560.998739:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1875683630446208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788791560.998764:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791560.998826:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1875683630446208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791560.998832:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788791560.999641:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba99366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630446208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791561.229096:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791561.229435:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606298752 00000100:00100000:3.0:1788791561.229447:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606298752 00000100:00100000:3.0:1788791561.229540:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:3.0:1788791561.229564:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+37:10372:x1875683606298752:12345-192.168.201.29@tcp:101:stat.0 00010000:00010000:3.0:1788791561.229588:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791561.229609:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3230d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367500f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.229674:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3230d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.229688:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3230d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.229698:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3230d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.229714:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3230e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.229722:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3230e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.229728:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3230e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.229823:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3230e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.229833:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230bd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675008 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.229842:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3230e7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.229886:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675008 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.229899:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675008 expref: 38 pid: 5836 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791561.229913:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85783800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875683630446336:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788791561.230023:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbcc7e40 going to sleep for 11 seconds 00000100:00080000:0.0:1788791561.230220:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791561.240208:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85783800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875683630446336:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791561.240252:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3230e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791561.255808:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791561.256330:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606299008 00000100:00100000:3.0:1788791561.256341:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606299008 00000100:00100000:3.0:1788791561.256454:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:3.0:1788791561.256465:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+39:5594:x1875683606299008:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788791561.256854:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+40:5594:x1875683606299008:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 379us (1045us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788791561.256863:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1788791561.265456:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791561.265753:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606299136 00000100:00100000:2.0:1788791561.265764:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606299136 00010000:00010000:2.0:1788791561.265810:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675008 expref: 40 pid: 5836 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791561.265856:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:2.0:1788791561.265867:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+40:2354:x1875683606299136:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791561.265881:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791561.265899:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675008 expref: 40 pid: 5836 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.265913:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675008 expref: 40 pid: 5836 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.265934:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675008 expref: 40 pid: 5836 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.265949:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:2.0:1788791561.265955:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3230e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.265964:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3230e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.265971:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3230e7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.266005:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791561.266058:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+39:2354:x1875683606299136:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 193us (611us total) trans 0 rc 0/0 00010000:00010000:0.0:1788791561.266064:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3230e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791561.266066:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00010000:00010000:0.0:1788791561.266077:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3230e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791561.266160:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788791561.266165:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791561.266209:0:5837:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3230e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266222:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3230e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266233:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3230d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266239:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3230d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266247:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3230d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266254:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791561.266258:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3230d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266266:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3230d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266277:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:0.0:1788791561.266280:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791561.266284:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3230d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266290:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3230d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266310:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3230e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266316:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3230e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266321:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3230e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266326:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16ce00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791561.266328:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3230e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266333:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3230e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266341:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba8823ca00) 00010000:00010000:0.0:1788791561.266343:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791561.266345:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3230e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266350:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3230e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266382:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3230d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367500f expref: 39 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266395:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3230e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367500f expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.266411:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:0.0:1788791561.266414:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788791561.266416:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d600, rc 0) 00000100:00100000:0.0:1788791561.266440:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+38:10372:x1875683606298752:12345-192.168.201.29@tcp:101:stat.0 Request processed in 36879us (37354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791561.266447:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:1.0:1788791561.342523:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791561.342666:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606299392 00000100:00100000:2.0:1788791561.342677:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606299392 00000100:00100000:2.0:1788791561.342789:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:2.0:1788791561.342801:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+38:10378:x1875683606299392:12345-192.168.201.29@tcp:36:truncate.0 00010000:00010000:2.0:1788791561.342857:0:8351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791561.342882:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3230e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367500f expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.342916:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:2.0:1788791561.342921:0:8351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788791561.343191:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.343205:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.343215:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788791561.343265:0:8351:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788791561.343286:0:8351:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000f15b9f76 reply state 00000000f173937f transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791561.343296:0:8351:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788791561.343526:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+40:10378:x1875683606299392:12345-192.168.201.29@tcp:36:truncate.0 Request processed in 726us (1012us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788791561.343545:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 54 00000020:00080000:2.0:1788791561.343551:0:8351:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788791561.353706:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.353726:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.353735:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.353755:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791561.353760:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.353768:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.353785:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:3.0:1788791561.353788:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791561.353794:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.353801:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3230ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791561.550744:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791561.550849:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606299520 00000100:00100000:2.0:1788791561.550860:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606299520 00000100:00100000:2.0:1788791561.551072:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:2.0:1788791561.551084:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+39:10392:x1875683606299520:12345-192.168.201.29@tcp:101:stat.0 00010000:00010000:2.0:1788791561.551111:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791561.551253:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a3230f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675016 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551468:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3230fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551483:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3230fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551494:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3230fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551509:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323103 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551517:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551534:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551635:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a32310a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551644:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a32310a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551652:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a32310a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791561.551687:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788791561.551692:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788791561.551715:0:5836:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a32310a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551738:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a32310a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551746:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3230fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551753:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3230fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551759:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3230fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551765:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81aa00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791561.551770:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3230fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551778:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3230fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551791:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:2.0:1788791561.551794:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791561.551799:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3230fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551806:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3230fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551820:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323103 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551826:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323103 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551838:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551843:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81bc00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791561.551846:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323103 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551853:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323103 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.551861:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba8533fd00) 00010000:00010000:2.0:1788791561.553407:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791561.553419:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323103 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.553429:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323103 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.553504:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a3230f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675016 expref: 41 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.553519:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a32310a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675016 expref: 40 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.553536:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:2.0:1788791561.553539:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788791561.553542:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81ae00, rc 0) 00000100:00100000:2.0:1788791561.553616:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+40:10392:x1875683606299520:12345-192.168.201.29@tcp:101:stat.0 Request processed in 2534us (2882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791561.553641:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:1.0:1788791561.610575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791561.610749:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606299776 00000100:00100000:3.0:1788791561.610759:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606299776 00000100:00100000:3.0:1788791561.610825:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:3.0:1788791561.610837:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+40:10402:x1875683606299776:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788791561.610870:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791561.611222:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323111 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367501d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791561.611339:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1788791561.611456:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323111 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367501d expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.611469:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba94530100) 00010000:00010000:3.0:1788791561.611480:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788791561.611486:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323111 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367501d expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.611500:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d200, rc 0) 00000100:00100000:3.0:1788791561.611581:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+41:10402:x1875683606299776:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 747us (1017us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788791561.611589:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:1.0:1788791561.615167:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791561.615532:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606300032 00000100:00100000:2.0:1788791561.615544:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606300032 00000100:00100000:2.0:1788791561.615646:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:2.0:1788791561.615656:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+41:10402:x1875683606300032:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788791561.615950:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+42:10402:x1875683606300032:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 294us (824us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788791561.615966:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:1.0:1788791561.656410:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791561.656504:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606300288 00000100:00100000:0.0:1788791561.656514:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606300288 00000100:00100000:0.0:1788791561.656587:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:0.0:1788791561.656597:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+42:10408:x1875683606300288:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1788791561.656619:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791561.656638:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32311f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675024 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.656737:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323126 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.656751:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a32310a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675016 expref: 43 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.656760:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323126 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.656795:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a32310a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675016 expref: 43 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.656808:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a32310a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675016 expref: 43 pid: 5836 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791561.656837:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc147100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875683630446464:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791561.657367:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababab3acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791561.661601:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc147100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875683630446464:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788791561.661628:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323126 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791561.661806:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791561.661930:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606300416 00000100:00100000:3.0:1788791561.661938:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606300416 00010000:00010000:3.0:1788791561.661982:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a32310a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675016 expref: 44 pid: 5836 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791561.662016:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:3.0:1788791561.662024:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+44:2355:x1875683606300416:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791561.662038:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791561.662044:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a32310a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675016 expref: 44 pid: 5836 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.662056:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a32310a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675016 expref: 44 pid: 5836 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.662078:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a32310a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675016 expref: 44 pid: 5836 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.662092:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:3.0:1788791561.662097:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323126 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.662117:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323126 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.662163:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323126 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.662221:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791561.662265:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+43:2355:x1875683606300416:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 242us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791561.662273:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00010000:00010000:1.0:1788791561.663426:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323126 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791561.663441:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323126 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791561.663460:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788791561.663611:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32311f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675024 expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791561.663628:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323126 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675024 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791561.663637:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:1.0:1788791561.663640:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788791561.663642:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe200, rc 0) 00000100:00100000:1.0:1788791561.663722:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+43:10408:x1875683606300288:12345-192.168.201.29@tcp:101:bash.0 Request processed in 7126us (7322us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1788791561.663730:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:1.0:1788791561.666279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791561.667763:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606300672 00000100:00100000:3.0:1788791561.667777:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606300672 00000100:00100000:3.0:1788791561.667836:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:3.0:1788791561.667845:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+43:10408:x1875683606300672:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:3.0:1788791561.668109:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a323134 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.668147:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a323134 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.668158:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a323134 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788791561.668208:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1788791561.668233:0:5839:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000fbed5d45 reply state 00000000ad0b79b1 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a323134 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791561.668242:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788791561.668346:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+46:10408:x1875683606300672:12345-192.168.201.29@tcp:36:bash.0 Request processed in 501us (2076us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788791561.668371:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00000020:00080000:3.0:1788791561.668376:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788791561.673316:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a323134 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791561.673330:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a323134 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791561.673335:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a323134 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791561.673352:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16da00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791561.673364:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a323134 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791561.673369:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a323134 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791561.673384:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:1.0:1788791561.673387:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791561.673391:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a323134 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791561.673397:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a323134 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791561.675636:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791561.676563:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606300800 00000100:00100000:2.0:1788791561.676576:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606300800 00000100:00100000:2.0:1788791561.676672:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:2.0:1788791561.676683:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+45:10408:x1875683606300800:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788791561.676706:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791561.676724:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32313b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367502b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.676814:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323142 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.676844:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323126 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675024 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.676853:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323142 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.676897:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323126 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675024 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.676930:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323126 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675024 expref: 46 pid: 5837 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791561.676946:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3080380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630446592:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788791561.677240:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ab9811f1780 going to sleep for 11 seconds 00000100:00100000:3.0:1788791561.679555:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791561.679679:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3080380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630446592:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791561.679702:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323142 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791561.679937:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606300928 00000100:00100000:0.0:1788791561.679946:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606300928 00010000:00010000:0.0:1788791561.679992:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323126 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675024 expref: 47 pid: 5837 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791561.680049:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:0.0:1788791561.680056:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+47:2354:x1875683606300928:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788791561.680068:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791561.680073:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323126 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675024 expref: 47 pid: 5837 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.680082:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323126 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675024 expref: 47 pid: 5837 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.680098:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323126 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675024 expref: 47 pid: 5837 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.680108:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:0.0:1788791561.680112:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323142 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.680185:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.680191:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323142 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.680206:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791561.680242:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+46:2354:x1875683606300928:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 187us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791561.680247:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 41 00010000:00010000:1.0:1788791561.680304:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791561.680312:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791561.680360:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788791561.680363:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791561.680379:0:5836:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791561.680401:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32313b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367502b expref: 46 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791561.680411:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367502b expref: 45 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791561.680421:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:1.0:1788791561.680423:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788791561.680425:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81bc00, rc 0) 00000100:00100000:1.0:1788791561.680445:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+45:10408:x1875683606300800:12345-192.168.201.29@tcp:101:bash.0 Request processed in 3766us (4819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791561.680450:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:3.0:1788791561.683468:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791561.683944:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606301184 00000100:00100000:2.0:1788791561.683954:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606301184 00000100:00100000:2.0:1788791561.684058:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:2.0:1788791561.684068:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba9921ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+45:10408:x1875683606301184:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:2.0:1788791561.684343:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba9921ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+46:10408:x1875683606301184:12345-192.168.201.29@tcp:35:bash.0 Request processed in 275us (884us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788791561.684351:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:1.0:1788791561.752717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791561.759191:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606301440 00000100:00100000:2.0:1788791561.759208:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606301440 00000100:00100000:2.0:1788791561.759290:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:2.0:1788791561.759302:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+46:10418:x1875683606301440:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791561.759327:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791561.759347:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a323149 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675032 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791561.760558:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1788791561.760705:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a323149 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675032 expref: 48 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.760723:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba94530100) 00010000:00010000:2.0:1788791561.760726:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788791561.760731:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a323149 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675032 expref: 48 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791561.760746:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81aa00, rc 0) 00000100:00100000:2.0:1788791561.762115:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+47:10418:x1875683606301440:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1528us (8121us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788791561.762612:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:1.0:1788791561.765640:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791561.765749:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606301568 00000100:00100000:0.0:1788791561.765760:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606301568 00000100:00100000:0.0:1788791561.765818:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:0.0:1788791561.765829:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+47:10418:x1875683606301568:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:0.0:1788791561.765917:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323157 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.765935:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323157 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.765946:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323157 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.765961:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32315e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.765968:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32315e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.765973:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32315e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766339:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323165 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766349:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766357:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788791561.766395:0:5837:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766407:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323157 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766413:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323157 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766419:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323157 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766425:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791561.766429:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323157 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766436:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323157 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766447:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:0.0:1788791561.766450:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791561.766454:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323157 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766468:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a323157 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766482:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32315e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766488:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32315e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766493:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32315e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766498:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fea00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791561.766501:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32315e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766506:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32315e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766513:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba94530d00) 00010000:00010000:0.0:1788791561.766516:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791561.766518:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32315e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766534:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32315e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766549:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323165 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766554:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323165 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766568:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323165 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766574:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fee00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791561.766577:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323165 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766583:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323165 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766590:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:0.0:1788791561.766592:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791561.766595:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323165 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.766600:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323165 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791561.766681:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+47:10418:x1875683606301568:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 853us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791561.766688:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:3.0:1788791561.770254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791561.770423:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606301824 00000100:00100000:0.0:1788791561.770433:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606301824 00000100:00100000:0.0:1788791561.770497:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:0.0:1788791561.770516:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+47:10418:x1875683606301824:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1788791561.770776:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+48:10418:x1875683606301824:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 261us (532us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788791561.770784:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:2.0:1788791561.816505:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791561.816624:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606302080 00000100:00100000:3.0:1788791561.816636:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606302080 00000100:00100000:3.0:1788791561.816697:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:3.0:1788791561.816708:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+48:10421:x1875683606302080:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788791561.816731:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791561.816752:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32316c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675039 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.816848:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323173 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.816863:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323173 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.816875:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323173 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.816890:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32317a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.816898:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32317a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.816905:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32317a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817194:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323181 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817204:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817211:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323181 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791561.817220:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788791561.817312:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323173 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817320:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323173 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817327:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323173 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817332:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c800 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791561.817337:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323173 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817344:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323173 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817437:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:3.0:1788791561.817440:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791561.817445:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323173 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817463:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323173 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817476:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32317a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817482:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32317a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817488:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32317a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817493:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16da00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791561.817496:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32317a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817502:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32317a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817510:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba8823cd00) 00010000:00010000:3.0:1788791561.817513:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791561.817515:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32317a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817531:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32317a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817573:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32316c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675039 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817587:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323181 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675039 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.817599:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:3.0:1788791561.817601:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788791561.817604:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d600, rc 0) 00000100:00100000:3.0:1788791561.817678:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3080380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+50:10421:x1875683606302080:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 971us (1184us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788791561.817686:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:2.0:1788791561.823508:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791561.823567:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791561.823586:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606302208 00000100:00100000:0.0:1788791561.823598:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606302208 00000100:00100000:3.0:1788791561.823647:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606302336 00000100:00100000:3.0:1788791561.823652:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606302336 00000100:00100000:0.0:1788791561.823666:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:0.0:1788791561.823679:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+51:10421:x1875683606302208:12345-192.168.201.29@tcp:54:lfs.0 00000100:00100000:3.0:1788791561.823704:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:3.0:1788791561.823714:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3083100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+51:2354:x1875683606302336:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791561.823726:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791561.823750:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323181 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675039 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.823751:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32318f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.823775:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32318f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.825639:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32318f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791561.828631:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:3.0:1788791561.828646:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791561.828731:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3083100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+50:2354:x1875683606302336:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 5012us (5157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791561.828745:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00010000:00010000:0.0:1788791561.828797:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32318f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.828810:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32318f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.828818:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32318f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.828829:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fee00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791561.828834:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32318f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.828843:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32318f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.828859:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:0.0:1788791561.828862:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788791561.828866:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32318f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791561.828887:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32318f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791561.828937:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3082d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+49:10421:x1875683606302208:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 5260us (5439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791561.828946:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:1.0:1788791561.839773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791561.840795:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606302592 00000100:00100000:0.0:1788791561.840807:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606302592 00000100:00100000:0.0:1788791561.840867:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1788791561.840878:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+49:10421:x1875683606302592:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1788791561.841099:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+50:10421:x1875683606302592:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 223us (1336us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788791561.841105:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00010000:00010000:1.0:1788791561.892480:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791562.002201:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791562.002317:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606302848 00000100:00100000:3.0:1788791562.002328:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606302848 00000100:00100000:3.0:1788791562.002387:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:3.0:1788791562.002398:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+50:10439:x1875683606302848:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:3.0:1788791562.002420:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791562.002438:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323196 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675040 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.002558:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32319d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.002580:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32319d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.002591:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32319d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791562.002601:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788791562.002702:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323196 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675040 expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.002720:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32319d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675040 expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.002729:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:3.0:1788791562.002732:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788791562.002735:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d200, rc 0) 00000100:00100000:3.0:1788791562.002796:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3081f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:10439:x1875683606302848:12345-192.168.201.29@tcp:101:cat.0 Request processed in 400us (603us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788791562.002803:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:2.0:1788791562.027603:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791562.028754:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606302976 00000100:00100000:1.0:1788791562.028769:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606302976 00000100:00100000:1.0:1788791562.028838:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:1.0:1788791562.028848:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:10440:x1875683606302976:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788791562.028871:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791562.028891:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a3231ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675047 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.028959:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a3231b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.028976:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a3231b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.028987:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a3231b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791562.029063:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1788791562.029068:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791562.029094:0:5836:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a3231b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.029121:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a3231ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675047 expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.029174:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a3231b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675047 expref: 53 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.029182:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:1.0:1788791562.029185:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788791562.029189:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c01c00, rc 0) 00000100:00100000:1.0:1788791562.029252:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3081180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+53:10440:x1875683606302976:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 405us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791562.029259:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:1.0:1788791562.048756:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791562.048864:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606303360 00000100:00100000:2.0:1788791562.048874:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606303360 00000100:00100000:2.0:1788791562.048929:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:2.0:1788791562.048939:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+53:10440:x1875683606303360:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788791562.049291:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:10440:x1875683606303360:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 353us (545us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788791562.049299:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:2.0:1788791562.057488:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791562.057592:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606303488 00000100:00100000:3.0:1788791562.057602:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606303488 00000100:00100000:3.0:1788791562.057667:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788791562.057678:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3080e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:10440:x1875683606303488:12345-192.168.201.29@tcp:103:lfs.0 00010000:00010000:3.0:1788791562.057696:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788791562.057737:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323142 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367502b expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.057758:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32319d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675040 expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.057770:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32304d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fec expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.057781:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:3.0:1788791562.057790:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791562.057857:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3080e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+51:10440:x1875683606303488:12345-192.168.201.29@tcp:103:lfs.0 Request processed in 181us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791562.057865:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788791562.060475:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791562.060797:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606303616 00000100:00100000:2.0:1788791562.060807:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606303616 00000100:00100000:2.0:1788791562.060877:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:2.0:1788791562.060886:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+51:10440:x1875683606303616:12345-192.168.201.29@tcp:58:lfs.0 00010000:00010000:2.0:1788791562.060983:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3231b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.061000:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3231b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.061013:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3231b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788791562.061469:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788791562.061822:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788791562.061899:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788791562.062001:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+51:10440:x1875683606303616:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 1113us (1533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791562.062009:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:1.0:1788791562.086188:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791562.086351:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606303744 00000100:00100000:0.0:1788791562.086361:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606303744 00000100:00100000:0.0:1788791562.086421:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 67 00000100:00100000:0.0:1788791562.086431:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+51:10442:x1875683606303744:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791562.086452:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791562.086473:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a3231c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367504e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.086955:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3231c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.086970:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3231c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.086981:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3231c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.086995:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3231ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.087001:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3231ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.087007:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3231ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.087115:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3231d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.087124:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3231d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.087220:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3231d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791562.088238:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788791562.088247:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791562.088272:0:5837:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3231d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088288:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3231d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088297:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3231c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088319:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3231c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088326:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3231c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088332:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fea00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791562.088337:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3231c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088345:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3231c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088359:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:1.0:1788791562.088362:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791562.088366:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3231c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088373:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3231c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088389:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3231ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088396:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3231ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088401:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3231ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088405:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791562.088414:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3231ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088419:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3231ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088426:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba94530d00) 00010000:00010000:1.0:1788791562.088428:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791562.088431:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3231ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088435:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3231ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088473:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a3231c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367504e expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088485:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3231d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367504e expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.088491:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:1.0:1788791562.088493:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788791562.088496:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fec00, rc 0) 00000100:00100000:1.0:1788791562.088716:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:10442:x1875683606303744:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 2285us (2536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791562.088724:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 67 00000040:00080000:1.0:1788791562.275333:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788791562.275342:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788791562.275391:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788791562.275397:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788791562.275547:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2da2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875683630446720:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788791562.275737:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab78da840 going to sleep for 11 seconds 00000100:00100000:1.0:1788791562.282788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791562.282887:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2da2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875683630446720:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788791562.282895:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606303872 00000100:00100000:0.0:1788791562.282940:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606303872 00000100:00100000:0.0:1788791562.283041:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:0.0:1788791562.283053:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:10453:x1875683606303872:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788791562.283199:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:10453:x1875683606303872:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 Request processed in 146us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791562.283208:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:3.0:1788791562.285566:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791562.285651:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606304000 00000100:00100000:1.0:1788791562.285661:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606304000 00000100:00100000:1.0:1788791562.285719:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:1.0:1788791562.285730:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:10453:x1875683606304000:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788791562.285765:0:8351:0:(mdt_handler.c:8010:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788791562.285870:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:10453:x1875683606304000:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 141us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791562.285878:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:1.0:1788791562.289363:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791562.289427:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606304128 00000100:00100000:3.0:1788791562.289437:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606304128 00000100:00100000:3.0:1788791562.289497:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:3.0:1788791562.289554:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:10453:x1875683606304128:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788791562.289770:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3231dc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.289787:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3231dc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.289799:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3231dc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290042:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3231e3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290051:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3231e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290058:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3231e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290084:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3231ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290302:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3231ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290310:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3231ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791562.290347:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788791562.290350:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788791562.290362:0:5836:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3231ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290373:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3231dc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290380:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3231dc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290386:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3231dc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290403:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791562.290408:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3231dc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290415:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3231dc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290428:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9aba8823c000) 00010000:00010000:3.0:1788791562.290431:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791562.290435:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3231dc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290440:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3231dc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290453:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3231e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290459:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3231e3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290466:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3231e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290471:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791562.290474:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3231e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290480:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3231e3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290499:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9aba8823c800) 00010000:00010000:3.0:1788791562.290561:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791562.290634:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3231e3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290642:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3231e3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290660:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3231ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290666:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3231ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290672:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3231ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290676:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791562.290680:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3231ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290686:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3231ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290695:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:3.0:1788791562.290698:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791562.290702:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3231ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.290707:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3231ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791562.290847:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:10453:x1875683606304128:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 1297us (1491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791562.290856:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:0.0:1788791562.293875:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791562.294030:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606304384 00000100:00100000:1.0:1788791562.294039:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606304384 00000100:00100000:1.0:1788791562.294097:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:1.0:1788791562.294106:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:10453:x1875683606304384:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788791562.294149:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791562.294170:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a3231f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675055 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.294275:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3231f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.294290:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3231f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.294302:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3231f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791562.294326:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788791562.294416:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3231f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.294424:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3231f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.294431:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3231f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.294437:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00e00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791562.294441:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3231f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.294448:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3231f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.294459:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:1.0:1788791562.294462:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788791562.294467:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3231f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.294473:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3231f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.294528:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a3231f1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675055 expref: 54 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.294539:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9aba8823c000) 00010000:00010000:1.0:1788791562.294542:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788791562.294552:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a3231f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675055 expref: 54 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.294562:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c00c00, rc 0) 00000100:00100000:1.0:1788791562.294630:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+53:10453:x1875683606304384:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 525us (766us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788791562.294638:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:3.0:1788791562.299548:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791562.299939:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606304512 00000100:00100000:1.0:1788791562.299950:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606304512 00000100:00100000:1.0:1788791562.300008:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:1.0:1788791562.300018:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+53:10453:x1875683606304512:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788791562.300054:0:5837:0:(mdt_handler.c:8010:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788791562.300175:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+53:10453:x1875683606304512:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 158us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791562.300348:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:2.0:1788791562.306632:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791562.306757:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606304768 00000100:00100000:1.0:1788791562.306767:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606304768 00000100:00100000:1.0:1788791562.306833:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:1.0:1788791562.306843:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+53:10453:x1875683606304768:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788791562.306862:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791562.306866:0:8351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788791562.306890:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a3231b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675047 expref: 53 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.306917:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:1.0:1788791562.306922:0:8351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788791562.306936:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323206 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367505c expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788791562.307422:0:8351:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788791562.307976:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a32320d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.307989:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a32320d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.308000:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a32320d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.308048:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323206 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367505c expref: 55 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.308062:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a32320d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367505c expref: 54 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.308070:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ababb052800) 00010000:00010000:1.0:1788791562.308072:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788791562.308075:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c00000, rc 0) 00000100:00100000:1.0:1788791562.308333:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3083800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:10453:x1875683606304768:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1490us (1710us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788791562.308342:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:1.0:1788791562.310994:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791562.312034:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606305024 00000100:00100000:3.0:1788791562.312045:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606305024 00000100:00100000:3.0:1788791562.312291:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 73 00000100:00100000:3.0:1788791562.312303:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:10453:x1875683606305024:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788791562.312361:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791562.312387:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a32320d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367505c expref: 54 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312406:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ababb052800) 00010000:00010000:3.0:1788791562.312417:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788791562.312440:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32321b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312452:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32321b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312461:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32321b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312474:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323222 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf61aec57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312481:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323222 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf61aec57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312503:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323222 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf61aec57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312596:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32321b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312604:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32321b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312611:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32321b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312617:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16da00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791562.312622:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32321b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312630:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32321b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312639:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:3.0:1788791562.312642:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791562.312646:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32321b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312652:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32321b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312662:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323222 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf61aec57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312668:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323222 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf61aec57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312681:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323222 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf61aec57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312686:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c800 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791562.312689:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323222 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf61aec57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312695:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323222 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf61aec57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312703:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf61aec57 (ffff9aba8823cd00) 00010000:00010000:3.0:1788791562.312711:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791562.312713:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323222 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf61aec57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.312718:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323222 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf61aec57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791562.312798:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+53:10453:x1875683606305024:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 497us (1811us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788791562.312806:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 73 00000100:00100000:3.0:1788791562.318768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791562.318805:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606305152 00000100:00100000:0.0:1788791562.318815:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606305152 00000100:00100000:0.0:1788791562.318884:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00100000:0.0:1788791562.318894:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+53:10453:x1875683606305152:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788791562.318914:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791562.318936:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323229 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675063 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.318972:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323230 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.318985:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.319009:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.319115:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323229 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675063 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.319163:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675063 expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.319173:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9aba94530c00) 00010000:00010000:0.0:1788791562.319182:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788791562.319186:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fee00, rc 0) 00000100:00100000:0.0:1788791562.319241:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:10453:x1875683606305152:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 348us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791562.319248:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00100000:2.0:1788791562.325922:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791562.325994:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606305408 00000100:00100000:3.0:1788791562.326003:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606305408 00000100:00100000:3.0:1788791562.326059:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:3.0:1788791562.326070:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:10453:x1875683606305408:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788791562.326175:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323237 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.326277:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323237 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.326288:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323237 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788791562.326864:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788791562.326877:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 338706749783ns, next at 339706747086ns, rc = 0 00000004:00010000:3.0:1788791562.326969:0:5837:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000070778644 reply state 000000007b668a39 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323237 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791562.326978:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788791562.327070:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3082680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+56:10453:x1875683606305408:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 1000us (1157us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788791562.327078:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 75 00010000:00010000:2.0:1788791562.334463:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323237 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.334481:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323237 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.334489:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323237 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.334496:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c800 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791562.334502:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323237 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.334510:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323237 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.334537:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9aba94530c00) 00010000:00010000:2.0:1788791562.334541:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788791562.334556:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323237 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.334563:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323237 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791562.336118:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791562.336259:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606305536 00000100:00100000:3.0:1788791562.336270:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606305536 00000100:00100000:3.0:1788791562.336387:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:3.0:1788791562.336397:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:10453:x1875683606305536:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788791562.336421:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791562.336439:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32323e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367506a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.336495:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32323e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367506a expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.336509:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32323e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367506a expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.336559:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9aba94530c00) 00010000:00010000:3.0:1788791562.336670:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788791562.336675:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16da00, rc 0) 00000100:00100000:3.0:1788791562.336767:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+56:10453:x1875683606305536:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 371us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791562.336774:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:2.0:1788791562.340371:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791562.340468:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606305664 00000100:00100000:3.0:1788791562.340477:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606305664 00000100:00100000:3.0:1788791562.340534:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:3.0:1788791562.340542:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875683606305664:12345-192.168.201.29@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788791562.340648:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp t0 exp 0000000000000000 cur 338 last 0 00000020:00000080:3.0:1788791562.340678:0:6683:0:(genops.c:1385:class_connect()) connect: client aafa64f5-7c0a-45ff-aeda-f3a6deb3b804, cookie 0xcd6380150a323245 00002000:00100000:3.0:1788791562.340689:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli aafa64f5-7c0a-45ff-aeda-f3a6deb3b804/ffff9aba867b2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788791562.340712:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788791562.341027:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788791562.341053:0:6683:0:(import.c:65:import_set_state_nolock()) ffff9aba867b7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788791562.341401:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2351:x1875683606305664:12345-192.168.201.29@tcp:8:lhsmtool_posix.0 Request processed in 857us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791562.341410:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:2.0:1788791562.343757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791562.343832:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606305792 00000100:00100000:3.0:1788791562.343841:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606305792 00000100:00100000:3.0:1788791562.343939:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:3.0:1788791562.343948:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:0:x1875683606305792:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788791562.345069:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788791562.389417:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1788791562.389430:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00000100:00100000:3.0:1788791562.389808:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:0:x1875683606305792:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 45853us (46052us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788791562.389820:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:3.0:1788791562.392240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791562.392478:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606306048 00000100:00100000:2.0:1788791562.392487:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606306048 00000100:00100000:2.0:1788791562.392550:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:2.0:1788791562.392559:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+56:10453:x1875683606306048:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788791562.392763:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:10453:x1875683606306048:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 204us (529us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788791562.392771:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:2.0:1788791562.400194:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791562.400332:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606306304 00000100:00100000:3.0:1788791562.400343:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606306304 00000100:00100000:3.0:1788791562.400403:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:3.0:1788791562.400414:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:10453:x1875683606306304:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788791562.400552:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:10453:x1875683606306304:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 139us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791562.400702:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:2.0:1788791562.403956:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791562.404064:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606306432 00000100:00100000:1.0:1788791562.404075:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606306432 00000100:00100000:3.0:1788791562.404193:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:3.0:1788791562.404205:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:10453:x1875683606306432:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788791562.404225:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791562.404244:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a32324c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675071 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.404310:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323253 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.404322:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.404334:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791562.404368:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788791562.404384:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323253 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.404409:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a32324c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675071 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.404441:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323253 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675071 expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.404450:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9aba94530c00) 00010000:00010000:3.0:1788791562.404453:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788791562.404457:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d200, rc 0) 00000100:00100000:3.0:1788791562.404525:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+58:10453:x1875683606306432:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 323us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791562.404532:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:0.0:1788791562.409249:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791562.409314:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606306560 00000100:00100000:2.0:1788791562.409324:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606306560 00000100:00100000:2.0:1788791562.409384:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:2.0:1788791562.409395:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2355:x1875683606306560:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788791562.409413:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791562.409433:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a32325a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675078 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788791562.409473:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ecb0a, blocks: 0x1 00010000:00010000:2.0:1788791562.409493:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=338s v=(0 0) 00010000:00010000:2.0:1788791562.409498:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791562.409507:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a32325a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675078 expref: 6 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.409540:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a32325a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675078 expref: 6 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.409553:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81ac00, rc 0) 00000100:00100000:2.0:1788791562.409687:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606306560:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 292us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791562.409694:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:2.0:1788791562.412946:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791562.413180:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606306816 00000100:00100000:1.0:1788791562.413191:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606306816 00000100:00100000:1.0:1788791562.413248:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:1.0:1788791562.413259:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+58:10453:x1875683606306816:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788791562.413359:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb486300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+58:10453:x1875683606306816:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 101us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791562.413366:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:3.0:1788791562.415903:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791562.416173:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606306944 00000100:00100000:0.0:1788791562.416183:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606306944 00000100:00100000:0.0:1788791562.416240:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:0.0:1788791562.416252:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:10453:x1875683606306944:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788791562.416269:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791562.416288:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf1785c3/0xcd6380150a323261 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367507f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.416320:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a32325a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675078 expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.416330:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791562.416334:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791562.416339:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf1785c3/0xcd6380150a323261 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367507f expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.416372:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a32325a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675078 expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.416385:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a32325a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675078 expref: 7 pid: 6683 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791562.416418:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc147800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6681:1875683630446848:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791562.416500:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababab3a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788791562.422056:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791562.422076:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc147800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6681:1875683630446848:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791562.422121:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf1785c3/0xcd6380150a323261 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a945367507f expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.422172:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff200, rc 0) 00000100:00100000:3.0:1788791562.422242:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:10453:x1875683606306944:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 5992us (6347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791562.422251:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:2.0:1788791562.422330:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606307072 00000100:00100000:2.0:1788791562.422337:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606307072 00010000:00010000:2.0:1788791562.422369:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a32325a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675078 expref: 7 pid: 6683 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791562.422402:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:2.0:1788791562.422412:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa001dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2355:x1875683606307072:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791562.422424:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791562.422445:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a32325a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675078 expref: 7 pid: 6683 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.422477:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a32325a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675078 expref: 7 pid: 6683 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.422497:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a32325a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675078 expref: 7 pid: 6683 timeout: 438 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.422529:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791562.422533:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791562.422541:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf1785c3/0xcd6380150a323261 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0xcf751a945367507f expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.422551:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf1785c3/0xcd6380150a323261 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0xcf751a945367507f expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.422853:0:8452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cf1785c3/0xcd6380150a323261 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a945367507f expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791562.422868:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8452:1875683630446976:192.168.201.29@tcp:105: 00000100:00100000:2.0:1788791562.422965:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ab9811f19c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791562.428592:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791562.428701:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606307200 00000100:00100000:3.0:1788791562.428711:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606307200 00002000:00100000:3.0:1788791562.428756:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ababc147b80 x1875683606307200/t0(0) o4->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:273/0 lens 504/0 e 0 to 0 dl 1788791573 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788791562.428767:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ababc147b80 with x1875683606307200 ext(0->8) 00002000:00010000:3.0:1788791562.428772:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ababc147b80 00000100:00100000:3.0:1788791562.428819:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1788791562.428837:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2355:x1875683606307200:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788791562.429491:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2355:x1875683606307200:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 Request processed in 654us (907us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788791562.429501:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00002000:00100000:3.0:1788791562.429521:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9ababc147b80 x1875683606307200/t4294967302(0) o4->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:273/0 lens 504/448 e 0 to 0 dl 1788791573 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788791562.429531:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ababc147b80 with x1875683606307200 ext(0->8) 00002000:00010000:3.0:1788791562.429535:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ababc147b80 00000100:00100000:2.0:1788791562.430123:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8452:1875683630446976:192.168.201.29@tcp:105: 00010000:00010000:2.0:1788791562.430186:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791562.430226:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa001dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2355:x1875683606307072:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 7815us (8179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791562.430235:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:0.0:1788791562.433238:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791562.433473:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606307328 00000100:00100000:3.0:1788791562.433484:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606307328 00000100:00100000:3.0:1788791562.433556:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:3.0:1788791562.433576:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+58:10453:x1875683606307328:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788791562.522908:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+58:10453:x1875683606307328:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 89332us (89670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791562.522923:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 80 00000001:00080000:2.0:1788791562.523576:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000001:00080000:2.0:1788791562.523596:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:2.0:1788791562.523605:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1788791562.523630:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788791562.523655:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9aba8665a9c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788791562.523660:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ababb9f0600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9aba86039300 00000020:00080000:2.0:1788791562.523663:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ababb9f0c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9aba8325a000 00000004:00080000:2.0:1788791562.523687:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:2.0:1788791562.523877:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630447104:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788791562.523932:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791562.523990:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630447104 00000100:00100000:2.0:1788791562.523998:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630447104 00000100:00100000:2.0:1788791562.524045:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788791562.524053:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630447104:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788791562.524219:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788791562.524222:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788791562 00002000:00010000:2.0:1788791562.524225:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788791562.524226:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788791562 -> 1788791562 00002000:00010000:2.0:1788791562.524228:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788791562.524262:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1875683630447104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 210us (330us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788791562.524270:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788791562.524288:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788791562.524318:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ababb787b80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788791562.524323:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb787b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630447104:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788791562.524503:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630447232:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788791562.524543:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791562.524622:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630447232 00000100:00100000:3.0:1788791562.524627:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630447232 00000100:00100000:3.0:1788791562.524665:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788791562.524672:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875683630447232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788791562.524688:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788791562.524714:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9ecb08, atime: 0x6a9ecb08, ctime: 0x6a9ecb08, blocks: 0x1 00010000:00010000:3.0:1788791562.524722:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a323268 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.524737:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=338s v=(0 0) 00010000:00010000:3.0:1788791562.524742:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791562.524748:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a323268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.524777:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a323268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.524786:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a323268 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.524794:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a323268 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.524811:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788791562.525283:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1875683630447232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 611us (739us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788791562.525291:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1788791562.525317:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791562.525323:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a323268 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.525332:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791562.525337:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a323268 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788791562.525455:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1788791562.525546:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1788791562.525622:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:3.0:1788791562.525962:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a323268 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.525986:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a323268 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.526002:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a323268 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.526024:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791562.526026:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791562.526028:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788791562.526079:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9abab2da0e00/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788791562.526085:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630447232:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788791562.529071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791562.529152:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606307456 00000100:00100000:2.0:1788791562.529169:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606307456 00000100:00100000:2.0:1788791562.529215:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:2.0:1788791562.529225:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2355:x1875683606307456:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788791562.612780:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2355:x1875683606307456:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 83543us (83704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791562.612794:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 30 00000001:00080000:2.0:1788791562.613283:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1788791562.613295:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1788791562.624217:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791562.629955:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606307712 00000100:00100000:2.0:1788791562.629968:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606307712 00000100:00100000:2.0:1788791562.630044:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:2.0:1788791562.630055:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:10453:x1875683606307712:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788791562.630102:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791562.630149:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323253 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675071 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.630166:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9aba94530c00) 00010000:00010000:2.0:1788791562.630170:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788791562.630199:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32326f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.630211:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32326f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.630220:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32326f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788791562.630435:0:5836:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000b14ae071 reply state 000000006e963b5c transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32326f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791562.630454:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788791562.630565:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:10453:x1875683606307712:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 511us (6359us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788791562.630573:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:0.0:1788791562.636182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:3.0:1788791562.638729:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32326f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.638745:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32326f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.638752:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32326f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.638758:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81be00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791562.638762:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32326f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.638769:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32326f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.638785:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9aba94530c00) 00010000:00010000:3.0:1788791562.638788:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791562.638792:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32326f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.638806:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32326f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791562.638845:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606307840 00000100:00100000:3.0:1788791562.638854:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606307840 00000100:00100000:3.0:1788791562.638918:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:3.0:1788791562.638928:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2354:x1875683606307840:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788791562.639196:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788791562.639199:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788791562 -> 1788791561 00002000:00010000:3.0:1788791562.639202:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788791560 00002000:00010000:3.0:1788791562.639204:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788791562 -> 1788791561 00002000:00010000:3.0:1788791562.639206:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788791562.639265:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2354:x1875683606307840:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 337us (3092us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788791562.639273:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:2.0:1788791562.641462:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791562.641677:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606308096 00000100:00100000:3.0:1788791562.641687:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606308096 00000100:00100000:3.0:1788791562.641742:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:3.0:1788791562.641752:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:10453:x1875683606308096:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788791562.641905:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323276 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.641924:0:8351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323230 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675063 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.641934:0:8351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323276 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.641985:0:8351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675063 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.641999:0:8351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323230 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675063 expref: 13 pid: 5839 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791562.642012:0:8351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb712300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8351:1875683630447360:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788791562.642107:0:8351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082840 going to sleep for 11 seconds 00000100:00100000:2.0:1788791562.647888:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791562.650004:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606308224 00000100:00100000:0.0:1788791562.650019:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606308224 00010000:00010000:0.0:1788791562.650060:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323230 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675063 expref: 14 pid: 5839 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791562.650097:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:0.0:1788791562.650107:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3083100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:2355:x1875683606308224:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788791562.650120:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791562.650141:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323230 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675063 expref: 14 pid: 5839 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.650153:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323230 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675063 expref: 14 pid: 5839 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.650173:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9aba94530c00) 00010000:00010000:0.0:1788791562.650177:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323276 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.650191:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.650198:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323276 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.650216:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791562.650272:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3083100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:2355:x1875683606308224:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 166us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791562.650280:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00010000:00010000:3.0:1788791562.653193:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323230 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675063 expref: 13 pid: 5839 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791562.653213:0:8351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb712300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8351:1875683630447360:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791562.653236:0:8351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.653245:0:8351:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.653251:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.653279:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.653286:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323276 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.653293:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323276 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.653311:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791562.653315:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323276 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.653323:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323276 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.653337:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9aba94530c00) 00010000:00010000:3.0:1788791562.653340:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788791562.653344:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323276 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.653349:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323276 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791562.653417:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3081880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+12:10453:x1875683606308096:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 Request processed in 11666us (11962us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788791562.653426:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:3.0:1788791562.656958:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791562.657030:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606308352 00000100:00100000:0.0:1788791562.657041:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606308352 00000100:00100000:0.0:1788791562.657103:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:0.0:1788791562.657115:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2354:x1875683606308352:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788791562.657183:0:10087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a32327d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.657202:0:10087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf1785c3/0xcd6380150a323261 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a945367507f expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.657211:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788791562.657216:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788791562.657221:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a32327d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.657252:0:10087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf1785c3/0xcd6380150a323261 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367507f expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.657282:0:10087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf1785c3/0xcd6380150a323261 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367507f expref: 7 pid: 6681 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791562.657297:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb926680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10087:1875683630447488:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791562.657372:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababab3a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788791562.661002:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb926680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10087:1875683630447488:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791562.661029:0:10087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a32327d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791562.661548:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791562.661603:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606308480 00000100:00100000:1.0:1788791562.661610:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606308480 00010000:00010000:1.0:1788791562.661644:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf1785c3/0xcd6380150a323261 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367507f expref: 8 pid: 6681 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791562.661686:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:1.0:1788791562.661696:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb712a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2355:x1875683606308480:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791562.661710:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791562.661746:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf1785c3/0xcd6380150a323261 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367507f expref: 8 pid: 6681 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.661761:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf1785c3/0xcd6380150a323261 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367507f expref: 8 pid: 6681 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.661788:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf1785c3/0xcd6380150a323261 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367507f expref: 8 pid: 6681 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.661804:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788791562.661808:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788791562.661814:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a32327d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.661831:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a32327d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.661857:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791562.661909:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb712a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2355:x1875683606308480:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 213us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791562.661916:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00010000:00010000:0.0:1788791562.662206:0:10087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a32327d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.662216:0:10087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a32327d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.662240:0:10087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a32327d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.662248:0:10087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a32327d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.662255:0:10087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a32327d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.662262:0:10087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791562.662266:0:10087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a32327d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.662288:0:10087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a32327d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.662300:0:10087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a32327d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.662307:0:10087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a32327d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791562.662366:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2354:x1875683606308352:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 5253us (5416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791562.662373:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:2.0:1788791562.670620:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791562.670694:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606308736 00000100:00100000:3.0:1788791562.670706:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606308736 00000100:00100000:3.0:1788791562.670766:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:3.0:1788791562.670776:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+12:10453:x1875683606308736:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788791562.670856:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323284 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.670873:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323284 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.670891:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323284 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.671078:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32328b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.671088:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32323e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367506a expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.671096:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32328b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.671163:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32323e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367506a expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.671177:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32323e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367506a expref: 13 pid: 5839 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791562.671190:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb711880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630447616:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788791562.671267:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082840 going to sleep for 11 seconds 00000100:00100000:3.0:1788791562.676748:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb711880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630447616:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791562.676776:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32328b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791562.678741:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791562.682662:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606308864 00000100:00100000:3.0:1788791562.682675:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606308864 00010000:00010000:3.0:1788791562.682719:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32323e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367506a expref: 14 pid: 5839 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791562.682785:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:3.0:1788791562.682794:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8625bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:2354:x1875683606308864:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791562.682808:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791562.682816:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32323e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367506a expref: 14 pid: 5839 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.682828:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32323e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367506a expref: 14 pid: 5839 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.682847:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32323e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367506a expref: 14 pid: 5839 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.682860:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9aba94530c00) 00010000:00010000:3.0:1788791562.682865:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32328b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.682873:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32328b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.682879:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32328b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.682900:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791562.682962:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8625bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:2354:x1875683606308864:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 168us (4229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791562.682970:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00010000:00010000:3.0:1788791562.682999:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32328b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.683011:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32328b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788791562.683197:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788791562.683345:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788791562.683386:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788791562.683475:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb711880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1875683630447744:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788791562.683538:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791562.683570:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788791562.683589:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630447744 00000100:00100000:3.0:1788791562.683593:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630447744 00000100:00100000:3.0:1788791562.683621:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788791562.683629:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875683630447744:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788791562.683692:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875683630447744:12345-0@lo:1000:mdt00_000.0 Request processed in 63us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791562.683699:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788791562.683733:0:5836:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788791562.683738:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ababb787b80, transno 4294967303 00000100:00100000:3.0:1788791562.683751:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb711880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1875683630447744:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788791562.684170:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788791562.684216:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb711880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1875683630447872:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788791562.684241:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791562.684256:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082840 going to sleep for 11 seconds 00000100:00100000:3.0:1788791562.684267:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630447872 00000100:00100000:3.0:1788791562.684270:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630447872 00000100:00100000:3.0:1788791562.684291:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788791562.684297:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875683630447872:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788791562.684423:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1875683630447872:12345-0@lo:1000:mdt00_000.0 Request processed in 126us (182us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788791562.684430:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788791562.684456:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb711880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1875683630447872:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788791562.684477:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32328b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684485:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32328b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684492:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32328b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684498:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791562.684502:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32328b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684526:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32328b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684538:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9aba94530c00) 00010000:00010000:3.0:1788791562.684540:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788791562.684544:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32328b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684550:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a32328b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684581:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3231b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684596:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3231b9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684601:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3231b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684606:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81ba00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791562.684609:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3231b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684614:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3231b9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684622:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:3.0:1788791562.684624:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788791562.684627:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3231b9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684632:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3231b9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684649:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323292 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684660:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3231d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367504e expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684668:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323292 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684686:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3231d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367504e expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791562.684702:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3231d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367504e expref: 16 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791562.684712:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb713800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630448000:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788791562.684752:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082840 going to sleep for 11 seconds 00000100:00100000:0.0:1788791562.689333:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791562.689467:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb713800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630448000:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791562.689493:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323292 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791562.691266:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606308992 00000100:00100000:2.0:1788791562.691280:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606308992 00010000:00010000:2.0:1788791562.691321:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3231d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367504e expref: 17 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791562.691393:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:2.0:1788791562.691402:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+17:2355:x1875683606308992:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791562.691415:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791562.691421:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3231d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367504e expref: 17 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.691434:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3231d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367504e expref: 17 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.691454:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3231d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367504e expref: 17 pid: 5837 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.691467:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:2.0:1788791562.691479:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323292 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.691488:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323292 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.691495:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323292 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791562.691541:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791562.691603:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+16:2355:x1875683606308992:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 202us (2278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791562.691610:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 46 00010000:00010000:0.0:1788791562.691656:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323292 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.691664:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323292 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.691676:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323292 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.691682:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323292 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.691689:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323292 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.691704:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791562.691708:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323292 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.691716:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323292 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.691725:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:0.0:1788791562.691728:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791562.691731:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323292 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.691737:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323292 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.691748:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323284 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.691754:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323284 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.691760:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323284 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.691764:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791562.691767:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323284 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.691772:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323284 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.691789:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:0.0:1788791562.691792:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788791562.691795:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323284 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.691801:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a323284 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791562.691993:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3080e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+15:10453:x1875683606308736:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 21218us (21382us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1788791562.692002:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 83 00000020:00080000:0.0:1788791562.692006:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788791562.692178:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788791562.692183:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788791562.692212:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788791562.692217:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788791562.694660:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791562.694754:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606309248 00000100:00100000:1.0:1788791562.694764:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606309248 00000100:00100000:1.0:1788791562.694936:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:1.0:1788791562.694946:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+15:10453:x1875683606309248:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788791562.695641:0:5840:0:(mdd_object.c:4131:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788791562.695756:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788791562.695804:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323299 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.695819:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.695829:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.695837:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323299 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.695843:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323299 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.695849:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323299 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791562.696020:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788791562.696401:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+17:10453:x1875683606309248:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 1453us (1747us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788791562.696410:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000020:00080000:1.0:1788791562.696415:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788791562.696478:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791562.696485:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323299 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.696492:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01e00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791562.696496:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323299 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.696503:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323299 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.696528:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9ababb052300) 00010000:00010000:0.0:1788791562.696538:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788791562.696543:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323299 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.696550:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323299 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791562.696565:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791562.696567:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791562.696569:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791562.916985:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788791562.961428:0:11997:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788791562.961438:0:11997:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788791562.961487:0:11997:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788791562.961493:0:11997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788791563.109768:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791563.109858:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606309504 00000100:00100000:0.0:1788791563.109869:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606309504 00000100:00100000:0.0:1788791563.109959:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:0.0:1788791563.109972:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+17:10463:x1875683606309504:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791563.109995:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791563.110018:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3232a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675086 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788791563.111036:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788791563.111671:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3232a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.111692:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3232a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.111705:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3232a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791563.111721:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1788791563.113667:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3232a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675086 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.113713:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3232a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675086 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.113723:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:0.0:1788791563.113726:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788791563.113731:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe200, rc 0) 00000100:00100000:0.0:1788791563.113799:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb787b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+19:10463:x1875683606309504:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 3829us (4040us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788791563.113808:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:2.0:1788791563.123959:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791563.124031:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606309632 00000100:00100000:1.0:1788791563.124040:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606309632 00000100:00100000:1.0:1788791563.124107:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:1.0:1788791563.124118:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+19:10463:x1875683606309632:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:1.0:1788791563.124216:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3232b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124232:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3232b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124251:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3232b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124267:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124274:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124280:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124570:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00600/0xcd6380150a3232c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124580:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00600/0xcd6380150a3232c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124586:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00600/0xcd6380150a3232c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788791563.124625:0:5837:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00600/0xcd6380150a3232c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124637:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3232b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124644:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3232b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124652:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3232b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124669:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791563.124674:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3232b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124681:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3232b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124693:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:1.0:1788791563.124697:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791563.124702:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3232b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124708:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3232b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124720:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124726:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124732:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124736:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791563.124739:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124744:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124762:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9ababb052700) 00010000:00010000:1.0:1788791563.124765:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791563.124767:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124773:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124787:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00600/0xcd6380150a3232c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124792:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00600/0xcd6380150a3232c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124796:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00600/0xcd6380150a3232c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124800:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791563.124802:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00600/0xcd6380150a3232c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124807:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00600/0xcd6380150a3232c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124813:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9ababb052300) 00010000:00010000:1.0:1788791563.124815:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791563.124817:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00600/0xcd6380150a3232c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.124967:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00600/0xcd6380150a3232c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791563.125112:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+19:10463:x1875683606309632:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 995us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791563.125121:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:2.0:1788791563.168402:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791563.168545:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606309888 00000100:00100000:3.0:1788791563.168556:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606309888 00000100:00100000:3.0:1788791563.168614:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:3.0:1788791563.168625:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+19:10466:x1875683606309888:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788791563.168648:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791563.168668:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3232ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367508d expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.168747:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3232d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.168762:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3232d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.168788:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3232d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.168803:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3232d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.168810:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3232d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.168817:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3232d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169155:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3232df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169165:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3232df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169173:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3232df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791563.169183:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788791563.169271:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3232d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169278:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3232d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169285:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3232d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169290:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16ce00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791563.169301:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3232d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169308:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3232d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169320:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:3.0:1788791563.169323:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791563.169327:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3232d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169334:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3232d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169344:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3232d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169351:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3232d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169357:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3232d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169362:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791563.169365:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3232d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169371:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3232d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169379:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba8823cd00) 00010000:00010000:3.0:1788791563.169381:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791563.169391:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3232d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169397:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3232d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169437:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3232ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367508d expref: 22 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169451:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3232df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367508d expref: 21 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.169458:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:3.0:1788791563.169460:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788791563.169462:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16da00, rc 0) 00000100:00100000:3.0:1788791563.169539:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+21:10466:x1875683606309888:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 915us (1145us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788791563.169546:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:2.0:1788791563.179994:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791563.180210:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606310016 00000100:00100000:3.0:1788791563.180221:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606310016 00000100:00100000:3.0:1788791563.180291:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:3.0:1788791563.180302:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+21:10466:x1875683606310016:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:3.0:1788791563.180369:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3232ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.180385:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3232ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.180396:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3232ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.180438:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3232ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.180444:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3232ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.180451:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3232ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.180457:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16de00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791563.180461:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3232ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.180468:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3232ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.180479:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:3.0:1788791563.180482:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788791563.180486:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3232ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.180492:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3232ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791563.180573:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+21:10466:x1875683606310016:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 272us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791563.180580:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:0.0:1788791563.186313:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791563.186365:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606310272 00000100:00100000:2.0:1788791563.186376:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606310272 00000100:00100000:2.0:1788791563.186442:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:2.0:1788791563.186453:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba9921cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+21:10466:x1875683606310272:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788791563.186686:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba9921cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+22:10466:x1875683606310272:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 235us (382us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788791563.186695:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:3.0:1788791563.221229:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791563.221642:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606310528 00000100:00100000:1.0:1788791563.221653:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606310528 00000100:00100000:1.0:1788791563.221715:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00100000:1.0:1788791563.221726:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+22:9992:x1875683606310528:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788791563.221750:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791563.221768:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00600/0xcd6380150a3232f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675094 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.221864:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.221879:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3232df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367508d expref: 23 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.221888:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232fb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.221920:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3232df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367508d expref: 23 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.221934:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3232df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367508d expref: 23 pid: 8351 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791563.221947:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2da1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875683630448128:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791563.222038:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791563.230942:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2da1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875683630448128:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791563.230971:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791563.232026:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791563.232200:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606310656 00000100:00100000:1.0:1788791563.232209:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606310656 00010000:00010000:1.0:1788791563.232246:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3232df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367508d expref: 24 pid: 8351 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791563.232287:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:1.0:1788791563.232298:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+24:2355:x1875683606310656:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791563.232312:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791563.232319:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3232df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367508d expref: 24 pid: 8351 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.232332:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3232df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367508d expref: 24 pid: 8351 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.232356:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3232df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367508d expref: 24 pid: 8351 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.232369:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:1.0:1788791563.232385:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.232394:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.232401:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232fb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.232433:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788791563.232487:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791563.232507:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+23:2355:x1875683606310656:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 198us (471us total) trans 0 rc 0/0 00010000:00010000:3.0:1788791563.232515:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791563.232515:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000004:00200000:3.0:1788791563.232534:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788791563.232702:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00600/0xcd6380150a3232f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675094 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.232719:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675094 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.232726:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:3.0:1788791563.232729:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788791563.232731:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c01400, rc 0) 00000100:00100000:3.0:1788791563.232770:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+23:9992:x1875683606310528:12345-192.168.201.29@tcp:101:bash.0 Request processed in 11047us (11551us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788791563.232777:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00100000:3.0:1788791563.235475:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791563.235567:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606310912 00000100:00100000:0.0:1788791563.235577:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606310912 00000100:00100000:0.0:1788791563.235711:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 89 00000100:00100000:0.0:1788791563.235723:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+23:9992:x1875683606310912:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:0.0:1788791563.235992:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323309 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.236008:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.236019:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788791563.236070:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788791563.236107:0:5836:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000004e2ceca9 reply state 00000000fbd268a8 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791563.236168:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788791563.236222:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788791563.236322:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+27:9992:x1875683606310912:12345-192.168.201.29@tcp:36:bash.0 Request processed in 600us (854us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788791563.236329:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 89 00000020:00080000:0.0:1788791563.236334:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788791563.239790:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323309 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.239822:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323309 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.239830:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323309 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.239835:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791563.239840:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323309 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.239861:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323309 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.239876:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:3.0:1788791563.239879:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791563.239884:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323309 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.239889:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323309 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791563.239989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791563.245715:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606311040 00000100:00100000:2.0:1788791563.245731:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606311040 00000100:00100000:2.0:1788791563.246059:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00100000:2.0:1788791563.246080:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+26:9992:x1875683606311040:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788791563.246533:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791563.246556:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323310 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367509b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.246743:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323310 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367509b expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.246760:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323310 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367509b expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.246779:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:2.0:1788791563.246783:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788791563.246787:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81ba00, rc 0) 00000100:00100000:2.0:1788791563.247295:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+27:9992:x1875683606311040:12345-192.168.201.29@tcp:101:bash.0 Request processed in 1224us (7308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791563.247304:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 90 00000100:00100000:1.0:1788791563.252909:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791563.252987:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606311168 00000100:00100000:3.0:1788791563.252997:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606311168 00000100:00100000:3.0:1788791563.253103:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:3.0:1788791563.253114:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:9992:x1875683606311168:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1788791563.253170:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791563.253195:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040722bbd/0xcd6380150a323317 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536750a2 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788791563.253224:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ecb09, atime: 0x6a9ecb08, ctime: 0x6a9ecb09, blocks: 0xb 00010000:00010000:3.0:1788791563.253245:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:3.0:1788791563.253250:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791563.253258:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040722bbd/0xcd6380150a323317 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750a2 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.253275:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000040722bbd/0xcd6380150a323317 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750a2 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.253304:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16de00, rc 0) 00000100:00100000:3.0:1788791563.253363:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:9992:x1875683606311168:12345-192.168.201.29@tcp:101:bash.0 Request processed in 251us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791563.253371:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:1.0:1788791563.255917:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791563.256054:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606311296 00000100:00100000:2.0:1788791563.256065:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606311296 00002000:00010000:2.0:1788791563.256332:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788791563.256337:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9abab2da3100 with x1875683606311296 ext(0->18446744073709551615) 00002000:00010000:2.0:1788791563.256350:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9abab2da3100. 00000100:00100000:2.0:1788791563.256403:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:2.0:1788791563.256424:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2353:x1875683606311296:12345-192.168.201.29@tcp:10:bash.0 00002000:00010000:2.0:1788791563.256782:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788791563.256786:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788791561 -> 1788791563 00002000:00010000:2.0:1788791563.256789:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788791560 -> 1788791560 00002000:00010000:2.0:1788791563.256791:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788791561 -> 1788791563 00002000:00010000:2.0:1788791563.256794:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788791563.256954:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2353:x1875683606311296:12345-192.168.201.29@tcp:10:bash.0 Request processed in 530us (1043us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788791563.256962:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00002000:00010000:2.0:1788791563.256966:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788791563.256969:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9abab2da3100 with x1875683606311296 ext(0->18446744073709551615) 00002000:00010000:2.0:1788791563.256974:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9abab2da3100. 00000100:00100000:1.0:1788791563.327008:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791563.327114:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606311424 00000100:00100000:2.0:1788791563.327124:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606311424 00000100:00100000:2.0:1788791563.327203:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:2.0:1788791563.327209:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+27:10480:x1875683606311424:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:2.0:1788791563.327270:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32331e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327283:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32331e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327292:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32331e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327301:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323325 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327320:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327324:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327801:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32332c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327809:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32332c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327814:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32332c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788791563.327845:0:8351:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32332c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327853:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32331e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327857:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32331e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327862:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32331e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327865:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81a600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791563.327869:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32331e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327873:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32331e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327887:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:2.0:1788791563.327889:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791563.327892:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32331e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327896:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32331e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327905:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323325 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327909:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323325 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327912:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327915:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791563.327916:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323325 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327920:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323325 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327923:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba8533f500) 00010000:00010000:2.0:1788791563.327924:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791563.327926:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323325 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327929:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323325 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327944:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32332c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327948:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32332c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327952:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32332c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327954:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81be00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791563.327956:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32332c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327959:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32332c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327963:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:2.0:1788791563.327964:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791563.327966:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32332c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.327969:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32332c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791563.328033:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+27:10480:x1875683606311424:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 823us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791563.328039:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:1.0:1788791563.379999:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791563.380116:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606311680 00000100:00100000:2.0:1788791563.380173:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606311680 00000100:00100000:2.0:1788791563.380241:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:2.0:1788791563.380266:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+27:10483:x1875683606311680:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791563.380287:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791563.380307:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323333 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536750a9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.380393:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32333a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.380408:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32333a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.380420:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32333a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.380435:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323341 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.380442:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.380449:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.380799:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323348 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.380820:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.380828:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791563.380848:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788791563.380938:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32333a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.380947:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32333a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.380953:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32333a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.380960:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791563.380964:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32333a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.380972:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32333a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.380984:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:2.0:1788791563.380987:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791563.380993:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32333a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.381000:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32333a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.381013:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323341 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.381020:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323341 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.381036:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.381042:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81a600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791563.381045:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323341 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.381051:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323341 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.381059:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba8533f500) 00010000:00010000:2.0:1788791563.381061:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791563.381064:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323341 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.381069:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323341 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.381111:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323333 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750a9 expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.381182:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750a9 expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.381192:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:2.0:1788791563.381195:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788791563.381197:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81b400, rc 0) 00000100:00100000:2.0:1788791563.381250:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+29:10483:x1875683606311680:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 987us (1261us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788791563.381268:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:1.0:1788791563.384017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791563.384111:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606311808 00000100:00100000:3.0:1788791563.384121:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606311808 00000100:00100000:3.0:1788791563.384211:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 93 00000100:00100000:3.0:1788791563.384221:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+29:10483:x1875683606311808:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:3.0:1788791563.384284:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323356 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.384300:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675094 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.384309:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323356 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.384355:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675094 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.384370:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675094 expref: 29 pid: 5839 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791563.384384:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb712d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875683630448256:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788791563.384475:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba880820c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791563.392418:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791563.392640:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606312064 00000100:00100000:2.0:1788791563.392652:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606312064 00000100:00100000:2.0:1788791563.392714:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:2.0:1788791563.392725:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+30:5594:x1875683606312064:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788791563.393063:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+31:5594:x1875683606312064:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 331us (646us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788791563.393072:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:3.0:1788791563.394297:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb712d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875683630448256:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791563.394404:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323356 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791563.399568:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791563.403639:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606312192 00000100:00100000:3.0:1788791563.403655:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606312192 00010000:00010000:3.0:1788791563.403707:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675094 expref: 31 pid: 5839 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791563.403762:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:3.0:1788791563.403772:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+31:2354:x1875683606312192:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791563.403788:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791563.403795:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675094 expref: 31 pid: 5839 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.403810:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675094 expref: 31 pid: 5839 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.403832:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3232fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675094 expref: 31 pid: 5839 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.403850:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:3.0:1788791563.403856:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323356 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.403865:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.403873:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323356 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.404007:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791563.404084:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+30:2354:x1875683606312192:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 313us (4525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791563.404093:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00010000:00010000:0.0:1788791563.418263:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.418280:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.418538:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.418547:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323356 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.418553:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323356 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.418559:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791563.418563:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323356 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.418571:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323356 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.418588:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:0.0:1788791563.418592:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788791563.418613:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323356 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.418620:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323356 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791563.418762:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+29:10483:x1875683606311808:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 34538us (34750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791563.418773:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 93 00000100:00100000:1.0:1788791563.426820:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791563.426899:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606312448 00000100:00100000:2.0:1788791563.426911:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606312448 00000100:00100000:2.0:1788791563.426973:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:2.0:1788791563.426984:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+29:10483:x1875683606312448:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788791563.427275:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+30:10483:x1875683606312448:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 291us (464us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788791563.427283:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:1.0:1788791563.549886:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791563.550119:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606312704 00000100:00100000:2.0:1788791563.550172:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606312704 00000100:00100000:2.0:1788791563.550225:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:2.0:1788791563.550236:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+30:10494:x1875683606312704:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:2.0:1788791563.550276:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791563.550298:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32335d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536750b0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.550374:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323364 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.550408:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323364 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.550420:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323364 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.550435:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32336b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.550443:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32336b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.550449:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32336b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.550807:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323372 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.550817:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.550824:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791563.550834:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788791563.550924:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323364 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.550933:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323364 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.550940:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323364 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.550953:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81a600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791563.550958:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323364 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.550965:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323364 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.550979:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:2.0:1788791563.550982:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791563.550987:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323364 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.550993:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323364 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.551005:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32336b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.551012:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32336b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.551018:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32336b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.551024:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791563.551027:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32336b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.551033:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32336b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.551052:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba8533f500) 00010000:00010000:2.0:1788791563.551054:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791563.551058:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32336b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.551064:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32336b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.551106:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32335d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750b0 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.551121:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323372 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750b0 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.551184:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:2.0:1788791563.551187:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788791563.551189:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81ae00, rc 0) 00000100:00100000:2.0:1788791563.551255:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+32:10494:x1875683606312704:12345-192.168.201.29@tcp:101:cat.0 Request processed in 1021us (1379us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788791563.551264:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:2.0:1788791563.558796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791563.558909:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606312960 00000100:00100000:0.0:1788791563.558920:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606312960 00000100:00100000:0.0:1788791563.558984:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:0.0:1788791563.558994:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+32:10494:x1875683606312960:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:0.0:1788791563.559280:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+33:10494:x1875683606312960:12345-192.168.201.29@tcp:35:cat.0 Request processed in 286us (492us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788791563.559288:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:1.0:1788791563.584545:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791563.584705:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606313216 00000100:00100000:2.0:1788791563.584716:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606313216 00000100:00100000:2.0:1788791563.584784:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00100000:2.0:1788791563.584796:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+33:10495:x1875683606313216:12345-192.168.201.29@tcp:36:rm.0 00010000:00010000:2.0:1788791563.584862:0:8351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788791563.584892:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323372 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750b0 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.584932:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323348 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750a9 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.584944:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323310 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367509b expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.584955:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8823c800) 00010000:00010000:2.0:1788791563.584964:0:8351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788791563.584984:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323380 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.584996:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323380 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.585006:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323380 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.585020:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323387 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.585027:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323387 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.585033:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323387 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.585392:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a32338e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.585401:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a32338e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.585415:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a32338e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788791563.587694:0:8351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788791563.587713:0:8351:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339967585691ns, next at 340967581907ns, rc = 0 00010000:00010000:2.0:1788791563.587802:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a323395 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.587819:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a323395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.587830:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a323395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.587838:0:8351:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a323395 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.587845:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a323395 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.587851:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a323395 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.587878:0:8351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791563.587902:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a32338e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.587909:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a32338e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.587915:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a32338e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.587931:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81aa00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791563.587936:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a32338e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.587944:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a32338e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.587956:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791563.587959:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788791563.587963:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a32338e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.587969:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a32338e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.587988:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323380 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.587994:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323380 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.588000:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323380 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.588004:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791563.588007:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323380 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.588012:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323380 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.588033:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:2.0:1788791563.588035:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791563.588038:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323380 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.588044:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323380 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788791563.588055:0:8351:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000201598f1 reply state 00000000c0193741 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323387 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791563.588064:0:8351:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788791563.588189:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+32:10495:x1875683606313216:12345-192.168.201.29@tcp:36:rm.0 Request processed in 3391us (3651us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788791563.588198:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 95 00010000:00010000:0.0:1788791563.591379:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791563.591397:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a323395 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.591408:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81ac00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791563.591413:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a323395 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.591424:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a323395 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.591444:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:0.0:1788791563.591447:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788791563.591452:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a323395 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.591476:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a323395 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.591517:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791563.591520:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791563.591522:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791563.602770:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323387 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.602792:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323387 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.602811:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323387 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.602819:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81a600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791563.602825:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323387 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.602834:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323387 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.602852:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba8533f500) 00010000:00010000:3.0:1788791563.602855:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791563.602860:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323387 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.602867:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323387 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791563.642409:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791563.642535:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606313472 00000100:00100000:2.0:1788791563.642546:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606313472 00000100:00100000:2.0:1788791563.642610:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:2.0:1788791563.642621:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+31:10501:x1875683606313472:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788791563.642644:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791563.642664:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32339c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536750b7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.642792:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3233a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.642814:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3233a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.642846:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3233a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.642862:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3233aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.642869:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3233aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.642876:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3233aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788791563.643550:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788791563.643717:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3233b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.643730:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3233b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.643736:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3233b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.643761:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3233a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.643766:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3233a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.643770:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3233a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.643774:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81aa00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791563.643776:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3233a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.643781:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3233a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.643789:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:3.0:1788791563.643791:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791563.643794:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3233a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.643797:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3233a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788791563.643805:0:5837:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000001fc8ae52 reply state 00000000fd6ec026 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3233aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791563.643815:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788791563.643836:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a32339c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750b7 expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.643845:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3233b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750b7 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.643850:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba8823c200) 00010000:00010000:3.0:1788791563.643851:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788791563.643853:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d000, rc 0) 00000100:00100000:3.0:1788791563.643912:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+34:10501:x1875683606313472:12345-192.168.201.29@tcp:101:bash.0 Request processed in 1293us (1514us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788791563.643917:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 96 00010000:00010000:3.0:1788791563.646608:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3233aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.646626:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3233aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.646634:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3233aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.646640:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81ba00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791563.646645:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3233aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.646653:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3233aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.646688:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba8533f200) 00010000:00010000:3.0:1788791563.646691:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791563.646696:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3233aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.646702:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3233aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791563.649954:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791563.650038:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606313600 00000100:00100000:3.0:1788791563.650058:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606313600 00000100:00100000:3.0:1788791563.650176:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:3.0:1788791563.650186:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2354:x1875683606313600:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1788791563.650204:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791563.650229:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3233bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536750be expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788791563.650257:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791563.650277:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1788791563.650283:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791563.650293:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3233bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750be expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.650311:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3233bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750be expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.650323:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16ce00, rc 0) 00000100:00100000:3.0:1788791563.650384:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2354:x1875683606313600:12345-192.168.201.29@tcp:101:bash.0 Request processed in 199us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791563.650408:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00080000:2.0:1788791563.650625:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791563.653982:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791563.654288:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606313728 00000100:00100000:0.0:1788791563.654298:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606313728 00000100:00100000:0.0:1788791563.654390:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:0.0:1788791563.654402:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:10501:x1875683606313728:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1788791563.654420:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791563.654437:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a3233c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536750c5 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.654470:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3233bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750be expref: 9 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.654479:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791563.654484:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791563.654499:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a3233c6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750c5 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.654533:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3233bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750be expref: 9 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.654547:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3233bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750be expref: 9 pid: 6683 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791563.654579:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb927b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1875683630448384:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791563.654670:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababab3a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788791563.658023:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791563.658269:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb927b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1875683630448384:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788791563.658303:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a3233c6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750c5 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.658324:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fea00, rc 0) 00000100:00100000:0.0:1788791563.658386:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:10501:x1875683606313728:12345-192.168.201.29@tcp:101:bash.0 Request processed in 3986us (4412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791563.658395:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:3.0:1788791563.658844:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606313856 00000100:00100000:3.0:1788791563.658853:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606313856 00010000:00010000:3.0:1788791563.658882:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3233bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750be expref: 9 pid: 6683 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791563.658916:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:3.0:1788791563.658924:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa001fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2355:x1875683606313856:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791563.658936:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791563.658956:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3233bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750be expref: 9 pid: 6683 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.658970:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3233bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750be expref: 9 pid: 6683 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.658990:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b35bafd/0xcd6380150a3233bf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750be expref: 9 pid: 6683 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.659004:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791563.659009:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791563.659016:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a3233c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750c5 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.659026:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a3233c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750c5 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.659315:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a3233c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750c5 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791563.659330:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb712d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5823:1875683630448512:192.168.201.29@tcp:105: 00000100:00100000:3.0:1788791563.659391:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788791563.662532:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb712d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5823:1875683630448512:192.168.201.29@tcp:105: 00010000:00010000:3.0:1788791563.662562:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791563.662620:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa001fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2355:x1875683606313856:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 3694us (4606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791563.662631:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:1.0:1788791563.665097:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791563.665237:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606314112 00000100:00100000:0.0:1788791563.665247:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606314112 00000100:00100000:0.0:1788791563.665306:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:0.0:1788791563.665317:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+33:10501:x1875683606314112:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:0.0:1788791563.666533:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+34:10501:x1875683606314112:12345-192.168.201.29@tcp:35:bash.0 Request processed in 1213us (1448us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788791563.666543:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:2.0:1788791563.825363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791563.825404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791563.825439:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791563.825542:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606314496 00000100:00100000:0.0:1788791563.825553:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606314496 00000100:00100000:0.0:1788791563.825632:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 133 00000100:00100000:0.0:1788791563.825642:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28665881-f918-4421-b36a-72ee58aec27e+5:2354:x1875683606314496:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791563.825711:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28665881-f918-4421-b36a-72ee58aec27e+5:2354:x1875683606314496:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 71us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791563.825735:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 133 00000100:00080000:2.0:1788791563.825803:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791563.825957:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606314368 00000100:00100000:3.0:1788791563.825962:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606314368 00000100:00100000:3.0:1788791563.826046:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:3.0:1788791563.826054:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2354:x1875683606314368:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791563.826111:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2354:x1875683606314368:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 57us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791563.826117:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:1.0:1788791563.826459:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606314240 00000100:00100000:1.0:1788791563.826464:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606314240 00000100:00100000:1.0:1788791563.826513:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 288 00000100:00100000:1.0:1788791563.826520:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2354:x1875683606314240:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791563.826555:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2354:x1875683606314240:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 36us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791563.826560:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 288 00000100:00100000:2.0:1788791563.827959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791563.828038:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606314624 00000100:00100000:0.0:1788791563.828045:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606314624 00000100:00100000:0.0:1788791563.828103:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00100000:0.0:1788791563.828111:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+34:10517:x1875683606314624:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791563.828153:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791563.828173:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3233cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536750cc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.828225:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3233d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.828239:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3233d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.828249:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3233d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791563.828302:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1788791563.828304:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791563.828323:0:5836:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3233d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.828356:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3233cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750cc expref: 36 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.828375:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3233d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750cc expref: 35 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.828400:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:0.0:1788791563.828403:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788791563.828406:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe400, rc 0) 00000100:00100000:0.0:1788791563.828455:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+35:10517:x1875683606314624:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 344us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791563.828462:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00100000:3.0:1788791563.832965:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791563.833012:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606314880 00000100:00100000:0.0:1788791563.833023:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606314880 00000100:00100000:0.0:1788791563.833449:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 98 00000100:00100000:0.0:1788791563.833461:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+35:10517:x1875683606314880:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791563.833481:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791563.833628:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3233db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536750d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.833745:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3233e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.833759:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3233e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.833771:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3233e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791563.833782:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788791563.834006:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3233db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750d3 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.834041:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3233e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750d3 expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.834310:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba8823c200) 00010000:00010000:0.0:1788791563.834314:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788791563.834318:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fec00, rc 0) 00000100:00100000:0.0:1788791563.834740:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+37:10517:x1875683606314880:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1279us (1783us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788791563.834749:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 98 00000100:00100000:2.0:1788791563.841901:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791563.841944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791563.842006:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606315136 00000100:00100000:3.0:1788791563.842017:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606315136 00000100:00100000:3.0:1788791563.842083:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:3.0:1788791563.842094:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+37:10517:x1875683606315136:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788791563.842119:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791563.842181:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3233f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536750da expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.842275:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3233f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791563.842276:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606315264 00000100:00100000:0.0:1788791563.842281:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606315264 00010000:00010000:3.0:1788791563.842290:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3233f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.842301:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3233f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791563.842311:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000004:00200000:3.0:1788791563.842313:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:0.0:1788791563.842317:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+39:2352:x1875683606315264:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788791563.842326:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791563.842353:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3233e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750d3 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.842368:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba8823c200) 00010000:00010000:0.0:1788791563.842373:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791563.842430:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+39:2352:x1875683606315264:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 112us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791563.842437:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00010000:00010000:3.0:1788791563.842438:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3233f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750da expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.842450:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3233f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750da expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.842457:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba8823c200) 00010000:00010000:3.0:1788791563.842460:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788791563.842462:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d600, rc 0) 00000100:00100000:3.0:1788791563.842497:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+38:10517:x1875683606315136:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 394us (595us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788791563.842504:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:2.0:1788791563.852335:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791563.852608:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606315392 00000100:00100000:3.0:1788791563.852620:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606315392 00000100:00100000:3.0:1788791563.853106:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:3.0:1788791563.853118:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2354:x1875683606315392:12345-192.168.201.29@tcp:1:lfs.0 00010000:00010000:1.0:1788791563.853398:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918878b9/0xcd6380150a323405 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.853427:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a3233c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750c5 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.853442:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791563.853446:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788791563.853454:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918878b9/0xcd6380150a323405 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.853496:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a3233c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750c5 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.853510:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a3233c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750c5 expref: 8 pid: 6681 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791563.853525:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2ff7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1875683630448640:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791563.853623:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788791563.857339:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791563.857444:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606315520 00000100:00100000:2.0:1788791563.857454:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606315520 00002000:00100000:2.0:1788791563.857532:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ababb927b80 x1875683606315520/t0(0) o4->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:274/0 lens 504/0 e 0 to 0 dl 1788791574 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788791563.857542:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ababb927b80 with x1875683606315520 ext(0->8) 00010000:00010000:2.0:1788791563.857551:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a3233c6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750c5 expref: 9 pid: 6681 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.857580:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a3233c6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750c5 expref: 9 pid: 6681 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788791563.857587:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ababb927b80 00000100:00100000:2.0:1788791563.857621:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:2.0:1788791563.857630:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2354:x1875683606315520:12345-192.168.201.29@tcp:4:lfs.0 00000100:00100000:2.0:1788791563.858115:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+11:2354:x1875683606315520:12345-192.168.201.29@tcp:4:lfs.0 Request processed in 483us (782us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788791563.858123:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00002000:00100000:2.0:1788791563.858163:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9ababb927b80 x1875683606315520/t4294967302(0) o4->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:274/0 lens 504/448 e 0 to 0 dl 1788791574 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788791563.858172:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ababb927b80 with x1875683606315520 ext(0->8) 00010000:00010000:2.0:1788791563.858179:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a3233c6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750c5 expref: 11 pid: 6681 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791563.858192:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a3233c6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750c5 expref: 11 pid: 6681 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788791563.858199:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ababb927b80 00000100:00100000:1.0:1788791563.862601:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2ff7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1875683630448640:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791563.862633:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000918878b9/0xcd6380150a323405 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791563.863892:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791563.864003:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606315648 00000100:00100000:0.0:1788791563.864011:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606315648 00010000:00010000:0.0:1788791563.864148:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a3233c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750c5 expref: 11 pid: 6681 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791563.864199:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:0.0:1788791563.864209:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+11:2355:x1875683606315648:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788791563.864225:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788791563.864245:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788791563.864248:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788791563 00002000:00010000:0.0:1788791563.864250:0:5824:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788791563 00002000:00010000:0.0:1788791563.864252:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788791563 00010000:00010000:0.0:1788791563.864257:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a3233c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750c5 expref: 11 pid: 6681 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.864269:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a3233c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750c5 expref: 11 pid: 6681 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.864293:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dc12e02/0xcd6380150a3233c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750c5 expref: 11 pid: 6681 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.864308:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788791563.864312:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788791563.864317:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000918878b9/0xcd6380150a323405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.864326:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918878b9/0xcd6380150a323405 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.864371:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791563.864427:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:2355:x1875683606315648:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 219us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791563.864435:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00010000:00010000:1.0:1788791563.864643:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000918878b9/0xcd6380150a323405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.864654:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918878b9/0xcd6380150a323405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.864678:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918878b9/0xcd6380150a323405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.864694:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000918878b9/0xcd6380150a323405 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.864701:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000918878b9/0xcd6380150a323405 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.864709:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791563.864713:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000918878b9/0xcd6380150a323405 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.864722:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000918878b9/0xcd6380150a323405 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.864735:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000918878b9/0xcd6380150a323405 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.864742:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000918878b9/0xcd6380150a323405 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791563.864793:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2354:x1875683606315392:12345-192.168.201.29@tcp:1:lfs.0 Request processed in 11678us (12469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791563.864801:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:0.0:1788791563.871267:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791563.871358:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606315904 00000100:00100000:1.0:1788791563.871369:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606315904 00000100:00100000:1.0:1788791563.871431:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:1.0:1788791563.871456:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99281050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+38:10517:x1875683606315904:12345-192.168.201.29@tcp:35:lfs.0 00000004:00010000:1.0:1788791563.871539:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3233f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750da expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788791563.871990:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788791563.872046:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788791563.872471:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788791563.872540:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32340c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.872555:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3233b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750b7 expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.872564:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32340c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.872596:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3233b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750b7 expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.872609:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3233b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750b7 expref: 42 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791563.872621:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2ff7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875683630448768:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791563.872690:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbcc7000 going to sleep for 11 seconds 00000100:00100000:2.0:1788791563.876054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791563.876149:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2ff7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875683630448768:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791563.876175:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32340c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791563.877002:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606316032 00000100:00100000:0.0:1788791563.877010:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606316032 00010000:00010000:0.0:1788791563.877048:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3233b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750b7 expref: 43 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791563.877198:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:0.0:1788791563.877210:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+43:2355:x1875683606316032:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788791563.877226:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791563.877234:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3233b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750b7 expref: 43 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.877247:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3233b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750b7 expref: 43 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.877266:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3233b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750b7 expref: 43 pid: 5837 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.877281:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba8823c200) 00010000:00010000:0.0:1788791563.877286:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32340c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.877307:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32340c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.877314:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32340c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.877340:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788791563.877440:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32340c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.877448:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32340c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788791563.877563:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788791563.877736:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1788791563.877838:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2ff7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875683630448896:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788791563.877894:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791563.877917:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba812edcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791563.877961:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+44:2355:x1875683606316032:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 753us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791563.877969:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:3.0:1788791563.878918:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630448896 00000100:00100000:3.0:1788791563.878927:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630448896 00000100:00100000:3.0:1788791563.879012:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788791563.879021:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5840:x1875683630448896:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788791563.879110:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5840:x1875683630448896:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 91us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791563.879117:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788791563.879202:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2ff7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875683630448896:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788791563.879611:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788791563.879670:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2ff7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875683630449024:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788791563.879700:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791563.879967:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbcc7000 going to sleep for 11 seconds 00000100:00100000:2.0:1788791563.879991:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630449024 00000100:00100000:2.0:1788791563.879996:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630449024 00000100:00100000:2.0:1788791563.880019:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788791563.880030:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5840:x1875683630449024:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788791563.880331:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5840:x1875683630449024:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 300us (628us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788791563.880338:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788791563.880458:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2ff7480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875683630449024:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788791563.880519:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788791563.880560:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32340c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.880571:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32340c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.880578:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32340c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.880585:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00c00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791563.880596:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32340c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.880603:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32340c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.880620:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba8823c200) 00010000:00010000:1.0:1788791563.880622:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788791563.880627:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32340c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791563.880632:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32340c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788791563.880875:0:5840:0:(mdd_object.c:4131:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788791563.881014:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788791563.881025:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340260897875ns, next at 341260896116ns, rc = 0 00000001:00080000:1.0:1788791563.881032:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788791563.881882:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba8823c200) 00010000:00010000:1.0:1788791563.881888:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788791563.881897:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3233f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750da expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791563.882231:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99281050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+45:10517:x1875683606315904:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 10775us (10972us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788791563.882241:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000020:00080000:1.0:1788791563.882247:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788791563.884734:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791563.884886:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606316160 00000100:00100000:0.0:1788791563.884896:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606316160 00000100:00100000:0.0:1788791563.884990:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00100000:0.0:1788791563.885001:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+45:10517:x1875683606316160:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791563.885023:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791563.885045:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323413 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536750e1 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.885269:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323413 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750e1 expref: 46 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.885284:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323413 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750e1 expref: 46 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791563.885301:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:0.0:1788791563.885304:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788791563.885308:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fea00, rc 0) 00000100:00100000:0.0:1788791563.885504:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+46:10517:x1875683606316160:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 503us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791563.885511:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00100000:3.0:1788791563.889517:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791563.890059:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606316416 00000100:00100000:1.0:1788791563.890071:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606316416 00000100:00100000:1.0:1788791563.890153:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:1.0:1788791563.890164:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+46:10517:x1875683606316416:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788791563.890392:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+47:10517:x1875683606316416:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 228us (891us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788791563.890400:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00010000:00010000:0.0:1788791563.940742:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791563.969236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791563.969296:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606316544 00000100:00100000:3.0:1788791563.969307:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606316544 00000100:00100000:3.0:1788791563.969376:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:3.0:1788791563.969387:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+47:10527:x1875683606316544:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:3.0:1788791563.969465:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a32341a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.969519:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a32341a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.969530:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a32341a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.969548:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323421 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.969554:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.969560:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.969678:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323428 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.969686:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.969692:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788791563.969731:0:5837:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.969743:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a32341a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.969749:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a32341a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.969755:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a32341a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.969760:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16ce00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791563.969764:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a32341a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.969771:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a32341a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.969782:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:3.0:1788791563.969786:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791563.969790:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a32341a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.970088:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a32341a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.970104:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323421 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.970110:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323421 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.970116:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323421 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.970121:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791563.970124:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323421 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.970172:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323421 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.970182:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba8823c400) 00010000:00010000:3.0:1788791563.970184:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791563.970187:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323421 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.970194:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323421 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.970207:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.970213:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323428 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.970226:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.970231:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791563.970234:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.970240:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.970249:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:3.0:1788791563.970251:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791563.970254:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323428 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791563.970260:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a323428 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791563.970516:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+47:10527:x1875683606316544:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 1117us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791563.970525:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:2.0:1788791564.011671:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791564.011775:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606316800 00000100:00100000:0.0:1788791564.011785:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606316800 00000100:00100000:0.0:1788791564.011859:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 102 00000100:00100000:0.0:1788791564.011870:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+47:10530:x1875683606316800:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791564.011890:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791564.011910:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32342f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536750e8 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.011986:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323436 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012001:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323436 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012012:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323436 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012027:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a32343d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012034:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a32343d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012041:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a32343d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012209:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323444 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012232:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012239:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323444 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791564.012249:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788791564.012345:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323436 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012353:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323436 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012359:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323436 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012365:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791564.012370:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323436 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012376:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323436 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012389:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:0.0:1788791564.012392:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791564.012397:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323436 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012403:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323436 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012416:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a32343d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012429:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a32343d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012435:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a32343d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012440:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791564.012443:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a32343d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012450:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a32343d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012458:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba94530400) 00010000:00010000:0.0:1788791564.012461:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791564.012463:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a32343d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012469:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a32343d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012695:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32342f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750e8 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012712:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750e8 expref: 49 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.012720:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:0.0:1788791564.012723:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788791564.012732:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff000, rc 0) 00000100:00100000:0.0:1788791564.012921:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+49:10530:x1875683606316800:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1051us (1258us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788791564.012930:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 102 00000100:00100000:1.0:1788791564.018093:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791564.018236:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606316928 00000100:00100000:0.0:1788791564.018246:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606316928 00000100:00100000:0.0:1788791564.018316:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 103 00000100:00100000:0.0:1788791564.018327:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+49:10530:x1875683606316928:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:0.0:1788791564.018416:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323452 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.018432:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.018444:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.018471:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323452 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.018478:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323452 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.018494:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323452 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.018501:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fee00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791564.018514:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323452 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.018522:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323452 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.018541:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:0.0:1788791564.018543:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788791564.018548:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323452 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.018554:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323452 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791564.018619:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+49:10530:x1875683606316928:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 294us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791564.018627:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 103 00000100:00100000:1.0:1788791564.021592:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791564.021678:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606317184 00000100:00100000:3.0:1788791564.021687:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606317184 00000100:00100000:3.0:1788791564.021743:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:3.0:1788791564.021753:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+49:10530:x1875683606317184:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:3.0:1788791564.021984:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+50:10530:x1875683606317184:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 231us (401us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788791564.021992:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:2.0:1788791564.096180:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791564.096337:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606317440 00000100:00100000:0.0:1788791564.096348:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606317440 00000100:00100000:0.0:1788791564.096414:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 104 00000100:00100000:0.0:1788791564.096426:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+50:10540:x1875683606317440:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1788791564.096451:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791564.096455:0:8351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788791564.096494:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3233d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750cc expref: 50 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.096514:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:0.0:1788791564.096519:0:8351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788791564.096534:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323459 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536750ef expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.096635:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323460 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.096668:0:8351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323444 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750e8 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.096676:0:8351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323460 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.096710:0:8351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323444 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750e8 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.096724:0:8351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323444 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750e8 expref: 50 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791564.096738:0:8351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb924000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8351:1875683630449152:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791564.097009:0:8351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababab3a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791564.102163:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791564.102472:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606317568 00000100:00100000:1.0:1788791564.102492:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606317568 00010000:00010000:1.0:1788791564.103297:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323444 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750e8 expref: 51 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791564.103334:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:1.0:1788791564.103344:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+51:2354:x1875683606317568:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791564.103359:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791564.103366:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323444 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750e8 expref: 51 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791564.103380:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323444 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750e8 expref: 51 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791564.103402:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:1.0:1788791564.103407:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323460 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791564.103417:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323460 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791564.103425:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323460 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791564.103461:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791564.103640:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb926300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+51:2354:x1875683606317568:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 296us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791564.103650:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00010000:00010000:2.0:1788791564.103930:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323444 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750e8 expref: 50 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791564.103947:0:8351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb924000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8351:1875683630449152:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791564.103967:0:8351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323460 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.103976:0:8351:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323460 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.103982:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323460 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791564.103997:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788791564.104158:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323459 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750ef expref: 51 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.104174:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323460 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750ef expref: 50 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.104182:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:2.0:1788791564.104193:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788791564.104196:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff200, rc 0) 00000100:00100000:2.0:1788791564.104229:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+50:10540:x1875683606317440:12345-192.168.201.29@tcp:101:bash.0 Request processed in 7806us (8058us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788791564.104236:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 104 00000100:00100000:1.0:1788791564.109742:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791564.109921:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606317824 00000100:00100000:3.0:1788791564.109931:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606317824 00000100:00100000:3.0:1788791564.110022:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 105 00000100:00100000:3.0:1788791564.110032:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+50:10540:x1875683606317824:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:3.0:1788791564.110369:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32346e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.110388:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32346e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.110400:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32346e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788791564.110494:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1788791564.110913:0:5837:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000038d54d78 reply state 000000007ffd060b transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32346e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791564.110924:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788791564.111034:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+53:10540:x1875683606317824:12345-192.168.201.29@tcp:36:bash.0 Request processed in 1002us (1301us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788791564.111042:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 105 00000020:00080000:3.0:1788791564.111047:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788791564.115648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791564.115745:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606317952 00000100:00100000:1.0:1788791564.115756:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606317952 00000100:00100000:1.0:1788791564.115827:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 106 00000100:00100000:1.0:1788791564.115838:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+53:10540:x1875683606317952:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788791564.115861:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791564.115883:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323475 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536750f6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791564.115995:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791564.116012:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323460 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750ef expref: 54 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791564.116021:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32346e lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791564.116061:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 5/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791564.116080:0:5839:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32346e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791564.116115:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323460 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750ef expref: 54 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791564.116160:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323460 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750ef expref: 54 pid: 8351 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791564.116175:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2ff5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875683630449280:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791564.116270:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8665ae40 going to sleep for 11 seconds 00010000:00010000:3.0:1788791564.119756:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32346e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.119774:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32346e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.119781:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32346e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.119787:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791564.119874:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32346e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.119882:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32346e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.119898:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:3.0:1788791564.119901:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791564.119904:0:3298:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.119914:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32346e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.119919:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a32346e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791564.120474:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791564.120737:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606318080 00000100:00100000:0.0:1788791564.120748:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606318080 00010000:00010000:0.0:1788791564.120782:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323460 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750ef expref: 54 pid: 8351 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791564.120834:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:0.0:1788791564.120844:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:2355:x1875683606318080:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788791564.120859:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791564.120866:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323460 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750ef expref: 54 pid: 8351 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.120893:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323460 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750ef expref: 54 pid: 8351 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.120910:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:0.0:1788791564.120914:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.120923:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.120929:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.120946:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791564.121001:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:2355:x1875683606318080:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 157us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791564.121008:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00010000:00010000:3.0:1788791564.121934:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323460 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750ef expref: 53 pid: 8351 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791564.121953:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2ff5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875683630449280:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791564.121975:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.121983:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.121988:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791564.122034:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788791564.122049:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788791564.122083:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.122146:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323475 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750f6 expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.122163:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750f6 expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.122173:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:3.0:1788791564.122175:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788791564.122178:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c01c00, rc 0) 00000100:00100000:3.0:1788791564.122780:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:10540:x1875683606317952:12345-192.168.201.29@tcp:101:bash.0 Request processed in 6939us (7139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791564.122802:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 106 00000100:00100000:1.0:1788791564.130327:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791564.130470:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606318336 00000100:00100000:3.0:1788791564.130488:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606318336 00000100:00100000:3.0:1788791564.130550:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:3.0:1788791564.130562:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:10540:x1875683606318336:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:3.0:1788791564.130972:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+53:10540:x1875683606318336:12345-192.168.201.29@tcp:35:bash.0 Request processed in 410us (653us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1788791564.130982:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:1.0:1788791564.232880:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791564.232986:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606318464 00000100:00100000:0.0:1788791564.233008:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606318464 00000100:00100000:0.0:1788791564.233072:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 107 00000100:00100000:0.0:1788791564.233083:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+53:10546:x1875683606318464:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791564.233105:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791564.233163:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323483 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536750fd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.233231:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32348a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.233264:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32348a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.233276:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32348a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791564.233337:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1788791564.233341:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791564.233364:0:5836:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32348a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.233388:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323483 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750fd expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.233406:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32348a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750fd expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.233414:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:0.0:1788791564.233417:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788791564.233422:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ffc00, rc 0) 00000100:00100000:0.0:1788791564.233474:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:10546:x1875683606318464:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 393us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791564.233491:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 107 00000100:00100000:1.0:1788791564.242909:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791564.243014:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606318592 00000100:00100000:2.0:1788791564.243025:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606318592 00000100:00100000:2.0:1788791564.243092:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 108 00000100:00100000:2.0:1788791564.243103:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:10546:x1875683606318592:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791564.243150:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791564.243171:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323491 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675104 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243235:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323498 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243248:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323498 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243259:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323498 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243274:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a32349f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243281:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a32349f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243288:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a32349f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243409:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243419:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243425:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791564.243461:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788791564.243465:0:8351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788791564.243494:0:8351:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243506:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243513:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323498 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243519:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323498 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243525:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323498 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243530:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791564.243535:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323498 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243542:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323498 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243563:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:2.0:1788791564.243565:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791564.243570:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323498 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243576:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323498 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243590:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a32349f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243595:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a32349f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243600:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a32349f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243606:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81ba00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791564.243608:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a32349f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243614:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a32349f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243620:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba8533f400) 00010000:00010000:2.0:1788791564.243623:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791564.243625:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a32349f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243631:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a32349f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243674:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323491 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675104 expref: 56 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243688:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675104 expref: 55 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.243696:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:2.0:1788791564.243698:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788791564.243700:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81b000, rc 0) 00000100:00100000:2.0:1788791564.243765:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:10546:x1875683606318592:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 663us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791564.243772:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 108 00000100:00100000:1.0:1788791564.255212:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791564.255311:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606318720 00000100:00100000:2.0:1788791564.255320:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606318720 00000100:00100000:2.0:1788791564.255376:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:2.0:1788791564.255386:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:2354:x1875683606318720:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791564.255402:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791564.255426:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675104 expref: 55 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.255445:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:2.0:1788791564.255449:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791564.255512:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:2354:x1875683606318720:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 126us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791564.255520:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1788791564.262907:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791564.263100:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606318976 00000100:00100000:0.0:1788791564.263111:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606318976 00000100:00100000:0.0:1788791564.263202:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 109 00000100:00100000:0.0:1788791564.263212:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:10546:x1875683606318976:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791564.263233:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791564.263264:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3234ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367510b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.263369:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3234b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.263384:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750f6 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.263392:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3234b4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.263425:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750f6 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.263438:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750f6 expref: 55 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791564.263451:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb925880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630449408:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791564.263836:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababab3a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788791564.266559:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791564.267029:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb925880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630449408:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788791564.267055:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3234b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791564.267625:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606319104 00000100:00100000:2.0:1788791564.267647:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606319104 00010000:00010000:2.0:1788791564.267683:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750f6 expref: 56 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791564.269036:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:2.0:1788791564.269055:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa001c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+56:2354:x1875683606319104:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791564.269072:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791564.269082:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750f6 expref: 56 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.269097:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750f6 expref: 56 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.269118:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32347c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750f6 expref: 56 pid: 5839 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.269151:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:2.0:1788791564.269156:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3234b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.269166:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3234b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.269173:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3234b4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.269196:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788791564.269402:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3234b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.269411:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3234b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791564.269443:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788791564.269600:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3234ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367510b expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.269615:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3234b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367510b expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.269623:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:0.0:1788791564.269625:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788791564.269628:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe600, rc 0) 00000100:00100000:2.0:1788791564.269677:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa001c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+56:2354:x1875683606319104:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 629us (3126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791564.269710:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:0.0:1788791564.273362:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:10546:x1875683606318976:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 10138us (10454us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788791564.273377:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 109 00000100:00100000:1.0:1788791564.281303:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791564.281401:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606319360 00000100:00100000:2.0:1788791564.281411:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606319360 00000100:00100000:2.0:1788791564.281488:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1788791564.281499:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:10546:x1875683606319360:12345-192.168.201.29@tcp:103:lfs.0 00010000:00010000:2.0:1788791564.281516:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791564.281542:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323413 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750e1 expref: 55 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.281562:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:2.0:1788791564.281566:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791564.281626:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:10546:x1875683606319360:12345-192.168.201.29@tcp:103:lfs.0 Request processed in 129us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791564.281634:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1788791564.285829:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791564.286775:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606319488 00000100:00100000:2.0:1788791564.287005:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606319488 00000100:00100000:2.0:1788791564.287093:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 110 00000100:00100000:2.0:1788791564.287104:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:10546:x1875683606319488:12345-192.168.201.29@tcp:58:lfs.0 00010000:00010000:2.0:1788791564.287362:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.287380:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.287394:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788791564.287637:0:8351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788791564.287933:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:10546:x1875683606319488:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 829us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791564.287942:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 110 00000100:00100000:1.0:1788791564.291357:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791564.291443:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606319616 00000100:00100000:3.0:1788791564.291453:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606319616 00000100:00100000:3.0:1788791564.291521:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 111 00000100:00100000:3.0:1788791564.291532:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:10546:x1875683606319616:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788791564.291563:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791564.291585:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3234c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675112 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.291639:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234c2 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.291650:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3234c9 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675112 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.291668:0:5837:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.291682:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3234c9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675112 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.291712:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:3.0:1788791564.291716:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788791564.291720:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3234c9 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675112 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.291728:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d200, rc 0) 00000100:00100000:3.0:1788791564.291802:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:10546:x1875683606319616:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 271us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791564.291809:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 111 00000040:00080000:0.0:1788791564.771736:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788791564.771746:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788791564.771799:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788791564.771806:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788791564.771931:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb925880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875683630449536:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788791564.772052:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababab3a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791564.775093:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb925880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875683630449536:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788791564.785798:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791564.796443:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606319744 00000100:00100000:3.0:1788791564.796461:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606319744 00000100:00100000:3.0:1788791564.796553:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 112 00000100:00100000:3.0:1788791564.796577:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:10547:x1875683606319744:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788791564.796609:0:5839:0:(mdt_handler.c:8010:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788791564.797200:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:10547:x1875683606319744:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 624us (11409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791564.797220:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 112 00000100:00100000:1.0:1788791564.812762:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791564.813066:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606319872 00000100:00100000:3.0:1788791564.813076:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606319872 00000100:00100000:3.0:1788791564.813168:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 113 00000100:00100000:3.0:1788791564.813180:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:10547:x1875683606319872:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788791564.813253:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3234d0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.813270:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3234d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.813283:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3234d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.813351:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3234d7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.813360:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3234d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.813366:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3234d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.813388:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a3234de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.813413:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a3234de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.813418:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a3234de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791564.813450:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788791564.813453:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788791564.813463:0:5837:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a3234de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.813482:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3234d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.813489:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3234d0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.813496:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3234d0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.813964:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791564.813971:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3234d0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.813980:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3234d0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.813992:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9aba8823c000) 00010000:00010000:3.0:1788791564.813996:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791564.814000:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3234d0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.814018:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a3234d0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.814034:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3234d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.814040:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3234d7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.814046:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3234d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.814050:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16ce00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791564.814053:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3234d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.814059:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3234d7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.814068:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9aba8823c400) 00010000:00010000:3.0:1788791564.814070:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791564.814073:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3234d7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.814078:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a3234d7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.814092:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a3234de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.814098:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a3234de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.814112:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a3234de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.814117:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c800 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791564.814120:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a3234de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.814785:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a3234de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.814799:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:3.0:1788791564.814801:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791564.814804:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a3234de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.814811:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a3234de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791564.814900:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:10547:x1875683606319872:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 1721us (2145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791564.814908:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 113 00000100:00100000:1.0:1788791564.817758:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791564.817953:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606320128 00000100:00100000:3.0:1788791564.817964:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606320128 00000100:00100000:3.0:1788791564.818094:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 114 00000100:00100000:3.0:1788791564.818106:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:10547:x1875683606320128:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788791564.818158:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791564.818180:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3234e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675119 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.818288:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3234ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.818303:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3234ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.818313:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3234ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791564.818325:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788791564.818422:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3234ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.818431:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3234ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.818437:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3234ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.818444:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791564.818448:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3234ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.818456:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3234ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.818479:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:3.0:1788791564.818483:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788791564.818488:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3234ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.818515:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3234ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.818560:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3234e5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675119 expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.818571:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9aba8823c000) 00010000:00010000:3.0:1788791564.818574:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788791564.818578:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3234e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675119 expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.818586:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d600, rc 0) 00000100:00100000:3.0:1788791564.818655:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7986a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+56:10547:x1875683606320128:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 551us (905us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1788791564.818662:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 114 00000100:00100000:1.0:1788791564.827647:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791564.827904:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606320256 00000100:00100000:2.0:1788791564.827915:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606320256 00000100:00100000:2.0:1788791564.827981:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:2.0:1788791564.827992:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+56:10547:x1875683606320256:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788791564.828030:0:5836:0:(mdt_handler.c:8010:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788791564.828762:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+56:10547:x1875683606320256:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 768us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791564.828772:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 115 00000100:00100000:1.0:1788791564.839881:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791564.840197:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606320512 00000100:00100000:2.0:1788791564.840208:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606320512 00000100:00100000:2.0:1788791564.840268:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:2.0:1788791564.840277:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+56:10547:x1875683606320512:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788791564.840298:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791564.840302:0:8351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788791564.840328:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32348a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750fd expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.840349:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:2.0:1788791564.840354:0:8351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788791564.840379:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a3234fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675120 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788791564.842726:0:8351:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788791564.844871:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323501 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.844892:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.844906:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.844999:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a3234fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675120 expref: 58 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.845019:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675120 expref: 57 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.845027:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9aba8533f400) 00010000:00010000:2.0:1788791564.845029:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788791564.845033:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81ba00, rc 0) 00000100:00100000:2.0:1788791564.845257:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:10547:x1875683606320512:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 4979us (5384us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788791564.845266:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 116 00000100:00100000:1.0:1788791564.850366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791564.850447:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606320768 00000100:00100000:3.0:1788791564.850458:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606320768 00000100:00100000:3.0:1788791564.850525:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:3.0:1788791564.850535:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:10547:x1875683606320768:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788791564.850591:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791564.850616:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323501 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675120 expref: 57 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.850634:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9aba8533f400) 00010000:00010000:3.0:1788791564.850645:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788791564.850667:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a32350f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.850708:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a32350f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.850720:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a32350f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.850739:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323516 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x8dc88f16 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.850747:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323516 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8dc88f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.850753:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323516 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8dc88f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.851102:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a32350f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.851111:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a32350f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.851118:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a32350f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.851123:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791564.851168:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a32350f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.851176:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a32350f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.851185:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:3.0:1788791564.851193:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791564.851198:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a32350f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.851204:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a32350f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.851216:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323516 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8dc88f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.851222:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323516 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8dc88f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.851227:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323516 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8dc88f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.851232:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791564.851235:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323516 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8dc88f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.851240:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323516 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8dc88f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.851247:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x8dc88f16 (ffff9aba8823c400) 00010000:00010000:3.0:1788791564.851250:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791564.851253:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323516 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8dc88f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.851258:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323516 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8dc88f16 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791564.851329:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+56:10547:x1875683606320768:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 795us (973us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788791564.851342:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 117 00000100:00100000:1.0:1788791564.859005:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791564.860426:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606320896 00000100:00100000:3.0:1788791564.860441:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606320896 00000100:00100000:3.0:1788791564.860517:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:3.0:1788791564.860529:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+56:10547:x1875683606320896:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788791564.860549:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791564.860571:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a32351d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675127 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.860607:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.860619:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.860630:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.860877:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a32351d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675127 expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.860896:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675127 expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.860905:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9aba8823c900) 00010000:00010000:3.0:1788791564.860908:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788791564.860977:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16ce00, rc 0) 00000100:00100000:3.0:1788791564.861049:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:10547:x1875683606320896:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 521us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791564.861063:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 118 00000100:00100000:1.0:1788791564.866689:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791564.866874:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606321152 00000100:00100000:3.0:1788791564.866885:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606321152 00000100:00100000:3.0:1788791564.866952:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00100000:3.0:1788791564.866962:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:10547:x1875683606321152:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788791564.867056:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32352b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.867074:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32352b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.867086:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32352b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788791564.867367:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:3.0:1788791564.867377:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341247249156ns, next at 342247246850ns, rc = 0 00000004:00010000:3.0:1788791564.867459:0:5837:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000004a29bece reply state 0000000043951ab2 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32352b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791564.867482:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788791564.867575:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+59:10547:x1875683606321152:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 613us (896us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788791564.867583:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 119 00000100:00100000:1.0:1788791564.874312:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791564.874417:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606321280 00000100:00100000:2.0:1788791564.874428:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606321280 00000100:00100000:2.0:1788791564.874516:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 120 00000100:00100000:2.0:1788791564.874528:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+59:10547:x1875683606321280:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788791564.874554:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791564.874590:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323532 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367512e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.874647:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323532 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367512e expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.874661:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323532 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367512e expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.874681:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9aba8823c900) 00010000:00010000:2.0:1788791564.874684:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788791564.874688:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81ae00, rc 0) 00000100:00100000:2.0:1788791564.874749:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+60:10547:x1875683606321280:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 224us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791564.874757:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 120 00010000:00010000:3.0:1788791564.875320:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32352b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.875330:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32352b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.875351:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32352b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.875357:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791564.875362:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32352b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.875369:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32352b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.875381:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9aba8823c900) 00010000:00010000:3.0:1788791564.875384:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788791564.875387:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32352b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791564.875394:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32352b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791564.881449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791564.881544:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606321408 00000100:00100000:3.0:1788791564.881554:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606321408 00000100:00100000:3.0:1788791564.881631:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:3.0:1788791564.881643:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2354:x1875683606321408:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788791564.881945:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2354:x1875683606321408:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 303us (505us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788791564.881954:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00080000:2.0:1788791564.882228:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788791564.887403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791564.887596:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606321664 00000100:00100000:0.0:1788791564.887606:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606321664 00000100:00100000:0.0:1788791564.887717:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:0.0:1788791564.887728:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+59:10547:x1875683606321664:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788791564.887982:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+60:10547:x1875683606321664:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 255us (586us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788791564.887989:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:1.0:1788791564.890284:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791564.890370:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606321920 00000100:00100000:3.0:1788791564.890379:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606321920 00000100:00100000:3.0:1788791564.891009:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:3.0:1788791564.891023:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+60:10547:x1875683606321920:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788791564.891187:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7987100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+60:10547:x1875683606321920:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 168us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791564.891196:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:1.0:1788791564.894492:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791564.894615:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606322048 00000100:00100000:0.0:1788791564.894625:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606322048 00000100:00100000:0.0:1788791564.894775:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 122 00000100:00100000:0.0:1788791564.894794:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+60:10547:x1875683606322048:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788791564.894812:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791564.894832:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323539 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675135 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.894904:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323540 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.894926:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323540 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.894938:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323540 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791564.894972:0:8351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791564.894989:0:8351:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323540 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.895025:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323539 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675135 expref: 62 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.895052:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323540 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675135 expref: 61 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.895077:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9aba8823c900) 00010000:00010000:0.0:1788791564.895080:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788791564.895084:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff600, rc 0) 00000100:00100000:0.0:1788791564.895181:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7987480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+61:10547:x1875683606322048:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 389us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791564.895188:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 122 00000100:00100000:1.0:1788791564.898428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791564.898531:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606322176 00000100:00100000:0.0:1788791564.898540:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606322176 00000100:00100000:0.0:1788791564.898579:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:0.0:1788791564.898588:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2355:x1875683606322176:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788791564.898605:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791564.898624:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a323547 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367513c expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788791564.898650:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ecb0c, blocks: 0x1 00010000:00010000:0.0:1788791564.898667:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=341s v=(0 0) 00010000:00010000:0.0:1788791564.898672:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791564.898680:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a323547 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367513c expref: 10 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.898710:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a323547 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367513c expref: 10 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.898724:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fea00, rc 0) 00000100:00100000:0.0:1788791564.898796:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:2355:x1875683606322176:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 208us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791564.898804:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:1.0:1788791564.904360:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791564.904497:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606322432 00000100:00100000:2.0:1788791564.904508:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606322432 00000100:00100000:2.0:1788791564.904627:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:2.0:1788791564.904639:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+61:10547:x1875683606322432:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788791564.904757:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7986680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+61:10547:x1875683606322432:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 121us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791564.904765:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:2.0:1788791564.921817:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791564.923258:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606322560 00000100:00100000:0.0:1788791564.923272:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606322560 00000100:00100000:1.0:1788791564.923623:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:1.0:1788791564.923634:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:10547:x1875683606322560:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788791564.923651:0:10087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791564.923669:0:10087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a32354e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675143 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791564.923702:0:10087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a323547 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367513c expref: 11 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791564.923712:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791564.923716:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791564.923721:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a32354e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675143 expref: 11 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791564.923754:0:10087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a323547 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367513c expref: 11 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791564.923769:0:10087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a323547 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367513c expref: 11 pid: 6681 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791564.923783:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab7985180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10087:1875683630449664:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791564.924081:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8665ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788791564.934580:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791564.934830:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606322688 00000100:00100000:0.0:1788791564.934840:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606322688 00010000:00010000:0.0:1788791564.934894:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a323547 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367513c expref: 12 pid: 6681 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791564.935071:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:0.0:1788791564.935082:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+12:2354:x1875683606322688:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788791564.935104:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791564.935174:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a323547 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367513c expref: 12 pid: 6681 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.935190:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a323547 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367513c expref: 12 pid: 6681 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.935215:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791564.935220:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791564.935228:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a32354e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675143 expref: 12 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.935237:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a32354e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675143 expref: 12 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791564.935302:0:8452:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a32354e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675143 expref: 12 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791564.935317:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb925500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8452:1875683630449792:192.168.201.29@tcp:105: 00000100:00100000:0.0:1788791564.935392:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababab3a0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788791564.936084:0:10087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dc12e02/0xcd6380150a323547 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367513c expref: 12 pid: 6681 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791564.936118:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab7985180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10087:1875683630449664:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791564.936188:0:10087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a32354e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675143 expref: 11 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791564.936201:0:10087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c00c00, rc 0) 00000100:00100000:2.0:1788791564.936254:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+11:10547:x1875683606322560:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 12621us (14447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791564.936263:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:0.0:1788791564.942214:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb925500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8452:1875683630449792:192.168.201.29@tcp:105: 00010000:00010000:0.0:1788791564.942242:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791564.942308:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:2354:x1875683606322688:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 7227us (7739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791564.942319:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:1.0:1788791564.943448:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791564.943600:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606322816 00000100:00100000:2.0:1788791564.943609:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606322816 00002000:00100000:2.0:1788791564.943659:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9abab7987b80 x1875683606322816/t0(0) o4->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:275/0 lens 504/0 e 0 to 0 dl 1788791575 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788791564.943669:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9abab7987b80 with x1875683606322816 ext(0->12) 00002000:00010000:2.0:1788791564.943674:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9abab7987b80 00000100:00100000:2.0:1788791564.943713:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:2.0:1788791564.943724:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:2355:x1875683606322816:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788791564.944245:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+12:2355:x1875683606322816:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 Request processed in 521us (799us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788791564.944254:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00002000:00100000:2.0:1788791564.944262:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9abab7987b80 x1875683606322816/t4294967308(0) o4->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:275/0 lens 504/448 e 0 to 0 dl 1788791575 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788791564.944270:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9abab7987b80 with x1875683606322816 ext(0->12) 00002000:00010000:2.0:1788791564.944278:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9abab7987b80 00000100:00100000:1.0:1788791564.949059:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791564.949222:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606322944 00000100:00100000:2.0:1788791564.949233:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606322944 00000100:00100000:2.0:1788791564.949363:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 124 00000100:00100000:2.0:1788791564.949375:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+61:10547:x1875683606322944:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1788791564.975758:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791565.021853:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+61:10547:x1875683606322944:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 72469us (72803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791565.021868:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 124 00000100:00100000:0.0:1788791565.024761:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791565.025021:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606323072 00000100:00100000:3.0:1788791565.025032:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606323072 00000100:00100000:3.0:1788791565.025098:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:3.0:1788791565.025109:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+12:2355:x1875683606323072:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788791565.026009:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:2.0:1788791565.026110:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1788791565.026160:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788791565.026247:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000004:00080000:2.0:1788791565.027004:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788791565.027031:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9ababb80fcc0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788791565.027036:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9abab30fec00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9ababb80fb40 00000020:00080000:2.0:1788791565.027048:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9aba9924ae00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ababb8bfc00 00000004:00080000:2.0:1788791565.027075:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1788791565.027098:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1788791565.027119:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9aba88082b40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788791565.027122:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9aba9930d900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9aba88082600 00000020:00080000:2.0:1788791565.027142:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9aba9930d600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9aba87e15800 00000100:00100000:2.0:1788791565.027302:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630449920:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788791565.027370:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791565.027442:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630450048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788791565.027488:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791565.027539:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630449920 00000100:00100000:2.0:1788791565.027546:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630449920 00000100:00100000:2.0:1788791565.027597:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630450048 00000100:00100000:2.0:1788791565.027600:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630450048 00000100:00100000:2.0:1788791565.027615:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788791565.027623:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1875683630449920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788791565.027657:0:10087:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1788791565.027682:0:10087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000652ca684/0xcd6380150a323555 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.027702:0:10087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000040722bbd/0xcd6380150a323317 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536750a2 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.027710:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788791565.027713:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788791565.027718:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000652ca684/0xcd6380150a323555 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.027742:0:10087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000040722bbd/0xcd6380150a323317 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750a2 expref: 12 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.027757:0:10087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000040722bbd/0xcd6380150a323317 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750a2 expref: 12 pid: 6682 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791565.027769:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10087:1875683630450176:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788791565.028034:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba86182480 going to sleep for 11 seconds 00000100:00080000:2.0:1788791565.028048:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788791565.028732:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788791565.028745:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630450304:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788791565.028908:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791565.028943:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788791565.028950:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000020:00080000:0.0:1788791565.029056:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788791565.029344:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788791565.029370:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630450304 00000100:00100000:0.0:1788791565.029375:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630450304 00000100:00080000:0.0:1788791565.029426:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788791565.029499:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788791565.029583:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3314:x1875683630450048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788791565.029749:0:12011:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788791565.029753:0:12011:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788791564 00002000:00010000:0.0:1788791565.029755:0:12011:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788791565.029756:0:12011:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788791564 -> 1788791564 00002000:00010000:0.0:1788791565.029758:0:12011:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:2.0:1788791565.031770:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ababb6d1500/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788791565.031910:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630450048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788791565.032290:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3314:x1875683630450048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2709us (4798us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788791565.032300:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788791565.032353:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788791565.032369:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3314:x1875683630450304:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788791565.032398:0:12011:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1788791565.032432:0:12011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ecb0b, atime: 0x6a9ecb0b, ctime: 0x6a9ecb0b, blocks: 0x1 00010000:00010000:0.0:1788791565.032441:0:12011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a32355c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.032458:0:12011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:0.0:1788791565.032462:0:12011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791565.032479:0:12011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a32355c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.032495:0:12011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a32355c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.034663:0:12011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a32355c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.034693:0:12011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a32355c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.034714:0:12011:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791565.034730:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791565.034737:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a32355c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.034745:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791565.034749:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a32355c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.034758:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a32355c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.036280:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a32355c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.036297:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a32355c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.036324:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791565.036326:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791565.036328:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791565.037017:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791565.037413:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10087:1875683630450176:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791565.037443:0:10087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000652ca684/0xcd6380150a323555 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791565.037498:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606323200 00000100:00100000:2.0:1788791565.038687:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606323200 00010000:00010000:2.0:1788791565.038735:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000040722bbd/0xcd6380150a323317 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750a2 expref: 13 pid: 6682 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791565.038912:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:3.0:1788791565.038926:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7986300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:2354:x1875683606323200:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791565.038942:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791565.038948:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000040722bbd/0xcd6380150a323317 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750a2 expref: 13 pid: 6682 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791565.039457:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3314:x1875683630450304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7094us (10546us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788791565.039483:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:3.0:1788791565.040002:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000040722bbd/0xcd6380150a323317 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750a2 expref: 13 pid: 6682 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.040030:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040722bbd/0xcd6380150a323317 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.29@tcp remote: 0xcf751a94536750a2 expref: 13 pid: 6682 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.040056:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788791565.040060:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788791565.040066:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000652ca684/0xcd6380150a323555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.040076:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000652ca684/0xcd6380150a323555 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.040123:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791565.040205:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7986300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+12:2354:x1875683606323200:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 1283us (3193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791565.040214:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00010000:00010000:1.0:1788791565.043309:0:10087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000652ca684/0xcd6380150a323555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.043330:0:10087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000652ca684/0xcd6380150a323555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.043342:0:10087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000652ca684/0xcd6380150a323555 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.043352:0:10087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000652ca684/0xcd6380150a323555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.043377:0:10087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788791565.044396:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3313:x1875683630449920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16769us (17022us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788791565.044409:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1788791565.044447:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791565.044454:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000652ca684/0xcd6380150a323555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.044474:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81aa00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791565.044479:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000652ca684/0xcd6380150a323555 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.044903:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000652ca684/0xcd6380150a323555 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.044926:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000652ca684/0xcd6380150a323555 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.044933:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000652ca684/0xcd6380150a323555 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.044956:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791565.044959:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791565.044960:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788791565.047016:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ababb924e00/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788791565.047034:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630450304:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788791565.051233:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ababb6d1880/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788791565.051253:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630449920:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1788791565.115885:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1788791565.115927:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1788791565.116388:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606323072:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 91265us (91619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791565.116400:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:3.0:1788791565.119443:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791565.120050:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606323456 00000100:00100000:0.0:1788791565.120061:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606323456 00000100:00100000:0.0:1788791565.120163:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 125 00000100:00100000:0.0:1788791565.120176:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+15:10547:x1875683606323456:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788791565.120227:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791565.120254:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323540 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675135 expref: 15 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.120273:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9aba8823c900) 00010000:00010000:0.0:1788791565.120278:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788791565.120309:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323563 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.120323:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.120333:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788791565.120454:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1788791565.121856:0:5837:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000002bb832ee reply state 000000004c706314 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791565.121871:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788791565.121987:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+16:10547:x1875683606323456:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 1812us (2620us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788791565.121997:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 125 00010000:00010000:1.0:1788791565.127658:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.127677:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323563 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.127685:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323563 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.127691:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791565.127697:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323563 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.127705:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323563 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.127722:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9aba8823c900) 00010000:00010000:1.0:1788791565.127740:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791565.127745:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323563 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.127751:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323563 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791565.129070:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791565.129183:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606323584 00000100:00100000:0.0:1788791565.129193:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606323584 00000100:00100000:0.0:1788791565.129252:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:0.0:1788791565.129264:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606323584:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788791565.129491:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788791565.129496:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788791564 -> 1788791564 00002000:00010000:0.0:1788791565.129498:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788791563 00002000:00010000:0.0:1788791565.129501:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788791564 -> 1788791564 00002000:00010000:0.0:1788791565.129503:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788791565.129561:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2355:x1875683606323584:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 299us (772us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788791565.129569:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:2.0:1788791565.133419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791565.133649:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606323840 00000100:00100000:0.0:1788791565.133661:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606323840 00000100:00100000:0.0:1788791565.133728:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 126 00000100:00100000:0.0:1788791565.133739:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+15:10547:x1875683606323840:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788791565.133828:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a32356a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.133864:0:8351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323524 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675127 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.133874:0:8351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a32356a lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.133910:0:8351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675127 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.133924:0:8351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323524 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675127 expref: 15 pid: 5839 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791565.133939:0:8351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb924700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8351:1875683630450432:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791565.134049:0:8351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababab3a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788791565.137854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791565.137996:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606323968 00000100:00100000:3.0:1788791565.138006:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606323968 00010000:00010000:3.0:1788791565.138055:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323524 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675127 expref: 16 pid: 5839 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791565.138097:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:3.0:1788791565.138107:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+16:2355:x1875683606323968:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791565.138122:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791565.138160:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323524 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675127 expref: 16 pid: 5839 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.138174:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323524 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675127 expref: 16 pid: 5839 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.138197:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9aba8823c900) 00010000:00010000:3.0:1788791565.138202:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a32356a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.138230:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a32356a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.138237:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a32356a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.138257:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791565.138308:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+16:2355:x1875683606323968:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 202us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791565.138317:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 57 00010000:00010000:0.0:1788791565.139066:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675127 expref: 15 pid: 5839 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791565.139086:0:8351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb924700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8351:1875683630450432:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788791565.139111:0:8351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a32356a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.139119:0:8351:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a32356a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.139172:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a32356a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.139202:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a32356a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.139219:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a32356a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.139226:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a32356a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.139233:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791565.139237:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a32356a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.139244:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a32356a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.139256:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9aba8823c900) 00010000:00010000:0.0:1788791565.139258:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788791565.139262:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a32356a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.139267:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a32356a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791565.139321:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:10547:x1875683606323840:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 Request processed in 5584us (5911us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788791565.139330:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 126 00000100:00100000:1.0:1788791565.142276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791565.142376:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606324096 00000100:00100000:2.0:1788791565.142385:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606324096 00000100:00100000:2.0:1788791565.142451:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:2.0:1788791565.142470:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2352:x1875683606324096:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788791565.142514:0:10087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bdbd5c3b/0xcd6380150a323571 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.142534:0:10087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a32354e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675143 expref: 7 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.142543:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791565.142547:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788791565.142552:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdbd5c3b/0xcd6380150a323571 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.142585:0:10087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a32354e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675143 expref: 7 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.142600:0:10087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a32354e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675143 expref: 7 pid: 10087 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791565.142629:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10087:1875683630450560:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788791565.142708:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba86182840 going to sleep for 11 seconds 00000100:00100000:1.0:1788791565.146839:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791565.147030:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606324224 00000100:00100000:3.0:1788791565.147040:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606324224 00010000:00010000:3.0:1788791565.147093:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a32354e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675143 expref: 8 pid: 10087 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791565.147172:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:3.0:1788791565.147183:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc115880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2355:x1875683606324224:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791565.147197:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791565.147219:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a32354e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675143 expref: 8 pid: 10087 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.147234:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a32354e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675143 expref: 8 pid: 10087 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.147261:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788791565.147265:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788791565.147272:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bdbd5c3b/0xcd6380150a323571 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.147289:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdbd5c3b/0xcd6380150a323571 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.147308:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791565.147355:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc115880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2355:x1875683606324224:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 174us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791565.147363:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00010000:00010000:2.0:1788791565.147587:0:10087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a32354e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675143 expref: 7 pid: 10087 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791565.147603:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10087:1875683630450560:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791565.147627:0:10087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bdbd5c3b/0xcd6380150a323571 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.147637:0:10087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bdbd5c3b/0xcd6380150a323571 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.147645:0:10087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdbd5c3b/0xcd6380150a323571 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.147670:0:10087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bdbd5c3b/0xcd6380150a323571 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.147678:0:10087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdbd5c3b/0xcd6380150a323571 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.147686:0:10087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdbd5c3b/0xcd6380150a323571 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.147706:0:10087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791565.147711:0:10087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdbd5c3b/0xcd6380150a323571 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.147719:0:10087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdbd5c3b/0xcd6380150a323571 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.147731:0:10087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdbd5c3b/0xcd6380150a323571 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.147739:0:10087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdbd5c3b/0xcd6380150a323571 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791565.147917:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2352:x1875683606324096:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 5456us (5649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791565.147925:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:1.0:1788791565.162713:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791565.165113:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606324480 00000100:00100000:2.0:1788791565.165142:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606324480 00000100:00100000:3.0:1788791565.165347:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 127 00000100:00100000:3.0:1788791565.165358:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:10547:x1875683606324480:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788791565.165554:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323578 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.165573:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.165585:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.166024:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a32357f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.166224:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323532 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367512e expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.166233:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a32357f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.166270:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323532 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367512e expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.166300:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323532 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367512e expref: 15 pid: 5839 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791565.166317:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb713b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630450688:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788791565.171699:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba81254600 going to sleep for 11 seconds 00000100:00100000:1.0:1788791565.180050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791565.180183:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606324608 00000100:00100000:2.0:1788791565.180193:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606324608 00010000:00010000:2.0:1788791565.180235:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323532 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367512e expref: 16 pid: 5839 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791565.180279:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:2.0:1788791565.180289:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc114e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+16:2355:x1875683606324608:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791565.180322:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791565.180330:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323532 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367512e expref: 16 pid: 5839 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.180344:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323532 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367512e expref: 16 pid: 5839 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.180366:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9aba8823c900) 00010000:00010000:2.0:1788791565.180385:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a32357f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.180395:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a32357f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.180402:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a32357f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791565.180421:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791565.180491:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc114e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+16:2355:x1875683606324608:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 203us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791565.180505:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 59 00010000:00010000:3.0:1788791565.181195:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323532 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367512e expref: 15 pid: 5839 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791565.181213:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb713b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630450688:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791565.181234:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a32357f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.181243:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a32357f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.181250:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a32357f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788791565.181445:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1788791565.181625:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1788791565.181684:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1788791565.181763:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb713b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1875683630450816:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788791565.182022:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791565.182186:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbaaaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788791565.182537:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630450816 00000100:00100000:2.0:1788791565.182545:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630450816 00000100:00100000:2.0:1788791565.182609:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788791565.182619:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1875683630450816:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788791565.182704:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5836:x1875683630450816:12345-0@lo:1000:mdt00_000.0 Request processed in 86us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791565.182711:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788791565.182920:0:5836:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788791565.182927:0:5836:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1788791565.182949:0:5836:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9ababb6d1500 x1875683630450048/t4294967309(4294967309) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788791581 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791565.182961:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb713b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1875683630450816:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788791565.183749:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788791565.183894:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc117800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1875683630450944:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788791565.183940:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791565.183974:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98323b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788791565.185350:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630450944 00000100:00100000:3.0:1788791565.185362:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630450944 00000100:00100000:3.0:1788791565.185421:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788791565.185441:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1875683630450944:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788791565.186599:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc114700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5836:x1875683630450944:12345-0@lo:1000:mdt00_000.0 Request processed in 1156us (2653us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788791565.186610:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788791565.186964:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc117800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1875683630450944:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788791565.187009:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a32357f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.187020:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a32357f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.187028:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a32357f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.187058:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16de00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791565.187063:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a32357f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.187071:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a32357f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.187087:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9aba8823c900) 00010000:00010000:1.0:1788791565.187089:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788791565.187094:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a32357f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.187101:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a32357f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.187333:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.187342:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234c2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.187348:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.187353:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791565.187357:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.187363:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234c2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.187397:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:1.0:1788791565.187399:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788791565.187406:0:5836:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3234c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675112 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.187418:0:5836:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3234c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675112 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.187426:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3234c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675112 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.187471:0:5836:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3234c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675112 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791565.187485:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc114a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630451072:192.168.201.29@tcp:105: 00000100:00100000:1.0:1788791565.187584:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbcc7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788791565.194507:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc114a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630451072:192.168.201.29@tcp:105: 00010000:00010000:3.0:1788791565.194538:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234c2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194551:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3234c2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194584:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323586 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194598:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323586 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194609:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323586 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194619:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323586 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194625:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323586 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194632:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323586 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194638:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c800 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791565.194642:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323586 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194663:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323586 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194675:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:3.0:1788791565.194678:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791565.194682:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323586 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194687:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323586 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194697:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194704:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323578 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194710:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323578 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194715:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791565.194717:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323578 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194723:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323578 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194729:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:3.0:1788791565.194731:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788791565.194734:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323578 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.194749:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323578 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788791565.196296:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788791565.196304:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788791565.197113:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc115500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:10547:x1875683606324480:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 31748us (34403us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1788791565.197140:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 127 00000020:00080000:3.0:1788791565.197148:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788791565.197328:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788791565.197336:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788791565.205076:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791565.205199:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606324736 00000100:00100000:1.0:1788791565.205210:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606324736 00000100:00100000:1.0:1788791565.205259:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:1.0:1788791565.205269:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:10546:x1875683606324736:12345-192.168.201.29@tcp:49:lfs.0 00000100:00100000:1.0:1788791565.205399:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:10546:x1875683606324736:12345-192.168.201.29@tcp:49:lfs.0 Request processed in 130us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791565.205422:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:3.0:1788791565.211997:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791565.212188:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606324992 00000100:00100000:2.0:1788791565.212198:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606324992 00000100:00100000:2.0:1788791565.212268:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 128 00000100:00100000:2.0:1788791565.212279:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:10546:x1875683606324992:12345-192.168.201.29@tcp:58:lfs.0 00000040:00080000:2.0:1788791565.212681:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788791565.212883:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:10546:x1875683606324992:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 604us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791565.212893:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 128 00000100:00100000:2.0:1788791565.214246:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791565.214411:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606325248 00000100:00100000:1.0:1788791565.214421:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606325248 00000100:00100000:1.0:1788791565.214480:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:1.0:1788791565.214490:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99281450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:10547:x1875683606325248:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788791565.216052:0:5840:0:(mdd_object.c:4131:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788791565.216358:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788791565.216416:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32358d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.216433:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32358d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.216445:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32358d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.216453:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32358d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.216459:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32358d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.216478:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32358d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791565.216510:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791565.216600:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791565.216608:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32358d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.216615:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791565.216619:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32358d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.216634:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32358d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.216646:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9ababb052700) 00010000:00010000:0.0:1788791565.216649:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788791565.216654:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32358d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.216659:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32358d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791565.216661:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99281450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+20:10547:x1875683606325248:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 2170us (2416us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788791565.216671:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00010000:00010000:0.0:1788791565.216676:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791565.216678:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791565.216679:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788791565.216682:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788791565.271684:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791565.271792:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606325376 00000100:00100000:3.0:1788791565.271803:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606325376 00000100:00100000:3.0:1788791565.271872:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 129 00000100:00100000:3.0:1788791565.271890:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+20:10549:x1875683606325376:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788791565.271916:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791565.271938:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323594 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367514a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.272009:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a32359b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.272024:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a32359b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.272035:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a32359b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.272062:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3235a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.272069:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3235a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.272089:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3235a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.272419:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3235a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.272431:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3234b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367510b expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.272438:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3235a9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.272486:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3234b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367510b expref: 21 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.272501:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3234b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367510b expref: 21 pid: 5836 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791565.272516:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb711f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875683630451200:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788791565.272608:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbaaa900 going to sleep for 11 seconds 00000100:00100000:2.0:1788791565.278768:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791565.278882:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606325632 00000100:00100000:0.0:1788791565.278894:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606325632 00000100:00100000:0.0:1788791565.278958:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:0.0:1788791565.278969:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+22:5594:x1875683606325632:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788791565.279439:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+23:5594:x1875683606325632:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 470us (680us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788791565.279447:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:3.0:1788791565.280427:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb711f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875683630451200:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791565.280455:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3235a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791565.290713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791565.290915:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606325760 00000100:00100000:3.0:1788791565.290925:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606325760 00010000:00010000:3.0:1788791565.290968:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3234b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367510b expref: 23 pid: 5836 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791565.291021:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:3.0:1788791565.291031:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa001e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+23:2354:x1875683606325760:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791565.291046:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791565.291053:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3234b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367510b expref: 23 pid: 5836 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.291065:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3234b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367510b expref: 23 pid: 5836 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.291089:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3234b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367510b expref: 23 pid: 5836 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.291105:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:3.0:1788791565.291110:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3235a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.291119:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3235a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.291423:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3235a9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791565.291457:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791565.291545:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa001e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+22:2354:x1875683606325760:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 515us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791565.291553:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00010000:00010000:0.0:1788791565.291711:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3235a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.291720:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3235a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791565.291766:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788791565.291790:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791565.291814:0:5837:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3235a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.291827:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3235a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.291836:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a32359b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.291843:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a32359b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.291850:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a32359b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.291856:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c800 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791565.291860:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a32359b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.291868:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a32359b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.291878:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:0.0:1788791565.291881:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791565.291884:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a32359b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.291889:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a32359b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.291900:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3235a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.291919:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3235a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.291925:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3235a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.291930:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791565.291933:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3235a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.291940:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3235a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.291948:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9aba8823c400) 00010000:00010000:0.0:1788791565.291951:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791565.291954:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3235a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.291960:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a3235a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.291998:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323594 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367514a expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.292012:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3235a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367514a expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791565.292019:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:0.0:1788791565.292021:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788791565.292029:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d600, rc 0) 00000100:00100000:0.0:1788791565.292058:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+21:10549:x1875683606325376:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 20177us (20386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791565.292065:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 129 00000100:00100000:1.0:1788791565.604892:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788791565.604950:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630451328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791565.605055:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791565.605206:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630451328 00000100:00100000:1.0:1788791565.605217:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630451328 00000100:00100000:1.0:1788791565.605298:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788791565.605310:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3313:x1875683630451328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788791565.605343:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788791565.606080:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630451584:0@lo:400:kworker.0 00000100:00100000:2.0:1788791565.606094:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630451840:0@lo:400:kworker.0 00000100:00100000:1.0:1788791565.606155:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc114380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3313:x1875683630451328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 845us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791565.606164:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788791565.606620:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630451456:0@lo:400:kworker.0 00000100:00100000:0.0:1788791565.606891:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791565.606938:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788791565.606946:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8508ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630451712:0@lo:400:kworker.0 00000100:00100000:0.0:1788791565.606973:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791565.608542:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630451584 00000100:00100000:3.0:1788791565.608579:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630451584 00000100:00100000:3.0:1788791565.608648:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630451712 00000100:00100000:3.0:1788791565.608652:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630451712 00000100:00100000:3.0:1788791565.608702:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788791565.608713:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630451584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791565.608810:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb924a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630451584:12345-0@lo:400:kworker.0 Request processed in 99us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791565.608818:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788791565.608837:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788791565.608843:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630451712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791565.608872:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630451712:12345-0@lo:400:kworker.0 Request processed in 30us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791565.608879:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788791565.608976:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8508ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630451712:0@lo:400:kworker.0 00000100:00100000:0.0:1788791565.608991:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630451584:0@lo:400:kworker.0 00000100:00080000:2.0:1788791565.609325:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791565.612307:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791565.612374:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630451840 00000100:00100000:2.0:1788791565.612386:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630451840 00000100:00100000:2.0:1788791565.612469:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788791565.612482:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630451840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791565.612553:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb485c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630451840:12345-0@lo:400:kworker.0 Request processed in 74us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791565.612574:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1788791565.612603:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791565.612662:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630451840:0@lo:400:kworker.0 00000100:00100000:1.0:1788791565.618273:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791565.618388:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630451328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791565.618522:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630451456 00000100:00100000:3.0:1788791565.618534:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630451456 00000100:00100000:3.0:1788791565.618605:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788791565.618619:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630451456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791565.618690:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3313:x1875683630451456:12345-0@lo:400:kworker.0 Request processed in 74us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791565.618699:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788791565.619109:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630451456:0@lo:400:kworker.0 00000001:00080000:0.0:1788791565.660181:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1788791565.660216:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:1.0:1788791565.987445:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791566.120256:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788791566.120288:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630451968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788791566.120383:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791566.120517:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630451968 00000100:00100000:1.0:1788791566.120529:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630451968 00000100:00100000:1.0:1788791566.120602:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788791566.120615:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630451968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788791566.120662:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791566.120720:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630451968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791566.120728:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788791566.120778:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788791566.120799:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:1.0:1788791566.120827:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9abab2da0e00, transno 4294967301 00000004:00080000:1.0:1788791566.120839:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1788791566.120850:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ababb924e00, transno 4294967304 00000100:00100000:1.0:1788791566.120864:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630451968:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788791566.217555:0:12050:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788791566.217566:0:12050:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788791566.217610:0:12050:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788791566.217622:0:12050:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788791566.253412:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788791566.253424:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788791566.253479:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788791566.253486:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788791566.253614:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb926d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875683630452096:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788791566.253701:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababab3a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788791566.264704:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791566.264797:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb926d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875683630452096:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788791566.265434:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606325888 00000100:00100000:3.0:1788791566.265453:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606325888 00000100:00100000:3.0:1788791566.265514:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 130 00000100:00100000:3.0:1788791566.265524:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+21:10561:x1875683606325888:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788791566.265574:0:5839:0:(mdt_handler.c:8010:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788791566.265674:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb486a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+21:10561:x1875683606325888:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 150us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791566.265682:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 130 00000100:00100000:2.0:1788791566.287914:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791566.294292:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606326144 00000100:00100000:0.0:1788791566.294310:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606326144 00000100:00100000:0.0:1788791566.294382:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00100000:0.0:1788791566.294393:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc00ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+21:10561:x1875683606326144:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788791566.294416:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791566.294452:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3235b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675151 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791566.294564:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a3235b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791566.294580:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a3235b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791566.294592:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a3235b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791566.294605:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788791566.294745:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3235b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675151 expref: 24 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791566.294761:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a3235b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675151 expref: 23 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791566.294769:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:0.0:1788791566.294772:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788791566.294775:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe000, rc 0) 00000100:00100000:0.0:1788791566.294849:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc00ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+23:10561:x1875683606326144:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 456us (6944us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788791566.294858:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 131 00000100:00100000:1.0:1788791566.310280:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791566.310322:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791566.310352:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606326528 00000100:00100000:1.0:1788791566.310362:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606326528 00000100:00100000:1.0:1788791566.310414:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 132 00000100:00100000:1.0:1788791566.310424:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+23:10561:x1875683606326528:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788791566.310520:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00400/0xcd6380150a3235c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791566.310539:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00400/0xcd6380150a3235c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791566.310551:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00400/0xcd6380150a3235c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791566.310736:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00400/0xcd6380150a3235c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791566.310745:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00400/0xcd6380150a3235c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791566.310751:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00400/0xcd6380150a3235c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791566.310757:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791566.310782:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00400/0xcd6380150a3235c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791566.310791:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00400/0xcd6380150a3235c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791566.310804:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:1.0:1788791566.310807:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788791566.310812:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00400/0xcd6380150a3235c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791566.310818:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00400/0xcd6380150a3235c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791566.310958:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc117100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+24:10561:x1875683606326528:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 534us (634us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788791566.310966:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 132 00000100:00100000:3.0:1788791566.314114:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606326272 00000100:00100000:3.0:1788791566.314162:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606326272 00000100:00100000:3.0:1788791566.314232:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1788791566.314244:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc116d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+24:2355:x1875683606326272:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791566.314259:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791566.314285:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a3235b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675151 expref: 24 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791566.314304:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:3.0:1788791566.314309:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791566.314365:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc116d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+23:2355:x1875683606326272:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 123us (4094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791566.314372:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000040:00080000:0.0:1788791566.323947:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788791566.323957:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788791566.324495:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788791566.324505:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788791566.330896:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791566.331117:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606326784 00000100:00100000:2.0:1788791566.331155:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606326784 00000100:00100000:2.0:1788791566.331219:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:2.0:1788791566.331238:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+23:10561:x1875683606326784:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788791566.331486:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+24:10561:x1875683606326784:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 258us (600us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788791566.331494:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00010000:00010000:0.0:1788791567.011321:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791568.038492:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788791568.134665:0:12102:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788791568.134675:0:12102:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788791568.135900:0:12102:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788791568.135909:0:12102:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788791568.263873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791568.263933:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606327040 00000100:00100000:1.0:1788791568.263944:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606327040 00000100:00100000:1.0:1788791568.264018:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 133 00000100:00080000:3.0:1788791568.264028:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791568.264030:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+24:10582:x1875683606327040:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788791568.264054:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791568.264072:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a3235cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675158 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791568.264201:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00400/0xcd6380150a3235d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791568.264214:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00400/0xcd6380150a3235d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791568.264225:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00400/0xcd6380150a3235d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791568.264235:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788791568.264342:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a3235cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675158 expref: 27 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791568.264359:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00400/0xcd6380150a3235d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675158 expref: 26 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791568.264367:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:1.0:1788791568.264371:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788791568.264374:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c00400, rc 0) 00000100:00100000:1.0:1788791568.264451:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+26:10582:x1875683606327040:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 418us (584us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788791568.264458:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 133 00000100:00100000:3.0:1788791568.267541:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791568.267588:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606327168 00000100:00100000:1.0:1788791568.267599:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606327168 00000100:00100000:1.0:1788791568.267663:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 134 00000100:00100000:1.0:1788791568.267674:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+26:10582:x1875683606327168:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:1.0:1788791568.267745:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3235e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791568.267774:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3235e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791568.267786:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3235e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791568.267812:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3235e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791568.267820:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3235e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791568.267826:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3235e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791568.267833:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791568.267837:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3235e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791568.267845:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3235e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791568.267856:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:1.0:1788791568.267859:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788791568.267863:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3235e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791568.267870:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01400/0xcd6380150a3235e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791568.267947:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+26:10582:x1875683606327168:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 275us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791568.267961:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 134 00000100:00100000:3.0:1788791568.373611:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791568.373728:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606327296 00000100:00100000:0.0:1788791568.373740:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606327296 00000100:00100000:0.0:1788791568.373826:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:0.0:1788791568.373838:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606327296:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:0.0:1788791568.373856:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791568.373878:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f03f07c/0xcd6380150a3235e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367515f expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788791568.373904:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ecb0c, atime: 0x6a9ecb0b, ctime: 0x6a9ecb0c, blocks: 0xb 00010000:00010000:0.0:1788791568.373924:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=344s v=(0 0) 00010000:00010000:0.0:1788791568.373929:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791568.373939:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f03f07c/0xcd6380150a3235e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367515f expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791568.373957:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f03f07c/0xcd6380150a3235e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367515f expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791568.373972:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe000, rc 0) 00000100:00100000:0.0:1788791568.374102:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2355:x1875683606327296:12345-192.168.201.29@tcp:101:cat.0 Request processed in 266us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791568.374111:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00080000:3.0:1788791568.374581:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788791568.385713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791568.386394:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606327424 00000100:00100000:2.0:1788791568.386415:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606327424 00002000:00100000:2.0:1788791568.386475:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9abab3083b80 x1875683606327424/t0(0) o3->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:279/0 lens 488/0 e 0 to 0 dl 1788791579 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788791568.386487:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9abab3083b80 with x1875683606327424 ext(0->4095) 00002000:00010000:2.0:1788791568.386493:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9abab3083b80 00000100:00100000:0.0:1788791568.386621:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:0.0:1788791568.386636:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2353:x1875683606327424:12345-192.168.201.29@tcp:3:cat.0 00000100:00100000:0.0:1788791568.386870:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3083b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2353:x1875683606327424:12345-192.168.201.29@tcp:3:cat.0 Request processed in 238us (1167us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788791568.386875:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00002000:00100000:0.0:1788791568.386886:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9abab3083b80 x1875683606327424/t0(0) o3->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:279/0 lens 488/4536 e 0 to 0 dl 1788791579 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788791568.386893:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9abab3083b80 with x1875683606327424 ext(0->4095) 00002000:00010000:0.0:1788791568.386896:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9abab3083b80 00000100:00100000:3.0:1788791568.948554:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791568.948782:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606327552 00000100:00100000:2.0:1788791568.948795:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606327552 00000100:00100000:2.0:1788791568.948862:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 290 00000100:00100000:2.0:1788791568.948873:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2355:x1875683606327552:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791568.948948:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2355:x1875683606327552:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 76us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791568.948956:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 290 00000100:00100000:3.0:1788791568.952182:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791568.952272:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606327680 00000100:00100000:1.0:1788791568.952282:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606327680 00000100:00100000:1.0:1788791568.952349:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 137 00000100:00100000:1.0:1788791568.952361:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+26:2355:x1875683606327680:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791568.952448:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3083480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+26:2355:x1875683606327680:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 89us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791568.952455:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 137 00000100:00100000:3.0:1788791568.957640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791568.957688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791568.957971:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606327936 00000100:00100000:1.0:1788791568.957982:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606327936 00000100:00100000:1.0:1788791568.958066:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 138 00000100:00100000:1.0:1788791568.958077:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28665881-f918-4421-b36a-72ee58aec27e+5:2354:x1875683606327936:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791568.958188:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28665881-f918-4421-b36a-72ee58aec27e+5:2354:x1875683606327936:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 113us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791568.958195:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 138 00000100:00100000:2.0:1788791568.958521:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606327808 00000100:00100000:2.0:1788791568.958527:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606327808 00000100:00100000:2.0:1788791568.958571:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:2.0:1788791568.958579:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2354:x1875683606327808:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791568.958632:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3083100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2354:x1875683606327808:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 54us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791568.958639:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00080000:3.0:1788791568.958963:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788791568.958968:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788791569.059835:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791570.083348:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788791570.256610:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1788791570.256625:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1788791570.256630:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1788791570.256635:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1788791570.285224:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:0.0:1788791570.285248:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1788791570.285296:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:2.0:1788791570.285313:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1788791570.285403:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788791570.285421:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9aba8665ae40 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788791570.285426:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9abab30fe300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9aba8665a9c0 00000020:00080000:0.0:1788791570.285429:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9abab30fea00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9aba99253000 00000020:00080000:1.0:1788791570.285476:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788791570.285673:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1788791570.725144:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8625bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630452224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791570.725237:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791570.725509:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630452224 00000100:00100000:3.0:1788791570.725518:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630452224 00000100:00100000:3.0:1788791570.725587:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788791570.725597:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630452224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788791570.725634:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791570.725685:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630452224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791570.725692:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1788791570.726255:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788791570.726301:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788791570.726307:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ababb6d1500, transno 4294967309 00000004:00080000:0.0:1788791570.726325:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ababb6d1880, transno 4294967310 00000004:00080000:0.0:1788791570.726330:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788791570.726359:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8625bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630452224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791570.731401:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791570.731424:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630452736:0@lo:400:kworker.0 00000100:00100000:1.0:1788791570.731424:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630452480:0@lo:400:kworker.0 00000100:00100000:0.0:1788791570.731794:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630452608:0@lo:400:kworker.0 00000100:00100000:3.0:1788791570.731960:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630452864:0@lo:400:kworker.0 00000100:00100000:2.0:1788791570.747851:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791570.747929:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630452352:0@lo:400:kworker.0 00000100:00100000:2.0:1788791570.747978:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791570.748639:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630452736 00000100:00100000:2.0:1788791570.748652:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630452736 00000100:00100000:2.0:1788791570.748738:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788791570.748748:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630452736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791570.748817:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630452736:12345-0@lo:400:kworker.0 Request processed in 70us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791570.748824:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788791570.748882:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc115f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630452736:0@lo:400:kworker.0 00000100:00100000:2.0:1788791570.748926:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630452352 00000100:00100000:2.0:1788791570.748930:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630452352 00000100:00100000:2.0:1788791570.748956:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788791570.748962:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630452352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791570.748996:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630452352:12345-0@lo:400:kworker.0 Request processed in 34us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791570.749002:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788791570.749066:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc115c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630452352:0@lo:400:kworker.0 00000100:00080000:2.0:1788791570.749187:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788791570.751700:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791570.752695:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630452608 00000100:00100000:2.0:1788791570.752707:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630452608 00000100:00100000:2.0:1788791570.752788:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788791570.752800:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630452608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791570.752874:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630452608:12345-0@lo:400:kworker.0 Request processed in 77us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791570.752881:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:0.0:1788791570.753051:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791570.753091:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc115180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630452608:0@lo:400:kworker.0 00000100:00100000:3.0:1788791570.757633:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791570.757688:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630452864 00000100:00100000:0.0:1788791570.757712:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630452864 00000100:00100000:0.0:1788791570.757789:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788791570.757799:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8625bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630452864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791570.757860:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8625bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630452864:12345-0@lo:400:kworker.0 Request processed in 63us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791570.757868:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788791570.757908:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc117b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630452864:0@lo:400:kworker.0 00000100:00080000:2.0:1788791570.758516:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791570.760419:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791570.760917:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630452480 00000100:00100000:2.0:1788791570.760928:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630452480 00000100:00100000:2.0:1788791570.760982:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788791570.760993:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630452480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791570.761078:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc114000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630452480:12345-0@lo:400:kworker.0 Request processed in 87us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791570.761085:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788791570.761432:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc116680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630452480:0@lo:400:kworker.0 00010000:00010000:0.0:1788791571.108732:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791571.237970:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788791571.238003:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630452992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791571.238110:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791571.239421:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630452992 00000100:00100000:3.0:1788791571.239438:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630452992 00000100:00100000:3.0:1788791571.239516:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788791571.239529:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630452992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788791571.239593:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791571.239687:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb927480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630452992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791571.239695:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788791571.240020:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb786300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630452992:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788791572.132391:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791573.155673:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791573.614464:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791573.614676:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606328064 00000100:00100000:3.0:1788791573.614687:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606328064 00000100:00100000:3.0:1788791573.614780:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 135 00000100:00100000:3.0:1788791573.614791:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:10234:x1875683606328064:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788791573.614898:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc116680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:10234:x1875683606328064:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 Request processed in 108us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791573.614905:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 135 00000100:00080000:2.0:1788791573.615807:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791573.630338:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791573.630467:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606328320 00000100:00100000:0.0:1788791573.630478:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606328320 00000100:00100000:0.0:1788791573.630538:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:0.0:1788791573.630549:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:10234:x1875683606328320:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788791573.631067:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:10234:x1875683606328320:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 516us (736us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788791573.631075:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:1.0:1788791573.874053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791573.877715:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606328448 00000100:00100000:2.0:1788791573.877731:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606328448 00000100:00100000:2.0:1788791573.877846:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 136 00000100:00100000:2.0:1788791573.877858:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28665881-f918-4421-b36a-72ee58aec27e+5:11035:x1875683606328448:12345-192.168.201.29@tcp:101:lsof.0 00010000:00010000:2.0:1788791573.877882:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791573.877910:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3235ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675166 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791573.877978:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a3235f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791573.878006:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a3235f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791573.878021:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a3235f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791573.878271:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788791573.878276:0:8351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1788791573.878382:0:8351:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a3235f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791573.878408:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a3235ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675166 expref: 7 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791573.878424:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a3235f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675166 expref: 6 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791573.878434:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba94530100) 00010000:00010000:2.0:1788791573.878437:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788791573.878441:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81b800, rc 0) 00000100:00100000:2.0:1788791573.878583:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc116a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:28665881-f918-4421-b36a-72ee58aec27e+6:11035:x1875683606328448:12345-192.168.201.29@tcp:101:lsof.0 Request processed in 726us (4538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791573.878591:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 136 00000100:00080000:0.0:1788791573.878869:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791574.061068:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791574.061117:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791574.061179:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791574.061365:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606328576 00000100:00100000:2.0:1788791574.061377:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606328576 00000100:00100000:2.0:1788791574.061441:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 292 00000100:00100000:2.0:1788791574.061463:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2353:x1875683606328576:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791574.061537:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2353:x1875683606328576:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 76us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791574.061560:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 292 00000100:00100000:0.0:1788791574.061607:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606328832 00000100:00100000:0.0:1788791574.061613:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606328832 00000100:00100000:1.0:1788791574.061727:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606328704 00000100:00100000:1.0:1788791574.061738:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606328704 00000100:00100000:0.0:1788791574.062314:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:0.0:1788791574.062326:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2353:x1875683606328832:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791574.062375:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb786300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2353:x1875683606328832:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 51us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791574.062389:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:1.0:1788791574.062442:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:1.0:1788791574.062558:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2353:x1875683606328704:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791574.062589:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2353:x1875683606328704:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 35us (1410us total) trans 0 rc 0/0 00000100:00080000:2.0:1788791574.062612:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788791574.062617:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788791574.065357:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00010000:00010000:0.0:1788791574.181188:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788791574.502532:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788791574.502542:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788791574.502791:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788791574.502798:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788791575.203536:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788791575.413314:0:12167:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788791575.413337:0:12167:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788791575.413388:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788791575.413397:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788791575.843491:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630453120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791575.843570:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791575.843714:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630453120 00000100:00100000:0.0:1788791575.843724:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630453120 00000100:00100000:0.0:1788791575.843801:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788791575.843812:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630453120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788791575.843851:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791575.843905:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc117b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630453120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791575.843912:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788791575.843973:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630453120:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788791575.844049:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788791575.844263:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630453632:0@lo:400:kworker.0 00000100:00100000:3.0:1788791575.844311:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791575.844336:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788791575.844342:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630453504:0@lo:400:kworker.0 00000100:00100000:3.0:1788791575.844367:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791575.844394:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630453632 00000100:00100000:3.0:1788791575.844402:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630453632 00000100:00100000:3.0:1788791575.844441:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788791575.844448:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630453632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791575.844485:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630453632:12345-0@lo:400:kworker.0 Request processed in 36us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791575.844492:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788791575.844510:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630453504 00000100:00100000:3.0:1788791575.844514:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630453504 00000100:00100000:3.0:1788791575.844540:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788791575.844546:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630453504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791575.844574:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630453504:12345-0@lo:400:kworker.0 Request processed in 29us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791575.844598:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1788791575.844634:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788791575.844638:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788791575.844656:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630453504:0@lo:400:kworker.0 00000100:00100000:3.0:1788791575.844665:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630453632:0@lo:400:kworker.0 00000100:00100000:1.0:1788791575.844749:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630453376:0@lo:400:kworker.0 00000100:00100000:1.0:1788791575.844776:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791575.844804:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788791575.844810:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab299df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630453248:0@lo:400:kworker.0 00000100:00100000:1.0:1788791575.844836:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791575.844858:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630453760:0@lo:400:kworker.0 00000100:00100000:1.0:1788791575.844880:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791575.845169:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630453376 00000100:00100000:3.0:1788791575.845174:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630453376 00000100:00100000:3.0:1788791575.845212:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630453760 00000100:00100000:3.0:1788791575.845215:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630453760 00000100:00100000:3.0:1788791575.845243:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788791575.845249:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630453376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791575.845299:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc115180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630453376:12345-0@lo:400:kworker.0 Request processed in 50us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791575.845305:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788791575.845317:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788791575.845323:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630453760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791575.845348:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc115c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630453760:12345-0@lo:400:kworker.0 Request processed in 26us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791575.845354:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:3.0:1788791575.845370:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791575.845628:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb702a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630453760:0@lo:400:kworker.0 00000100:00100000:1.0:1788791575.845640:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630453376:0@lo:400:kworker.0 00000100:00100000:2.0:1788791575.845878:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630453248 00000100:00100000:2.0:1788791575.845883:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630453248 00000100:00100000:2.0:1788791575.845916:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788791575.845931:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3315:x1875683630453248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791575.845979:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3315:x1875683630453248:12345-0@lo:400:kworker.0 Request processed in 56us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791575.845985:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788791575.846550:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab299df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630453248:0@lo:400:kworker.0 00010000:00010000:0.0:1788791576.227484:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791576.355733:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630453888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791576.355820:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791576.356028:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630453888 00000100:00100000:0.0:1788791576.356037:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630453888 00000100:00100000:0.0:1788791576.356092:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788791576.356103:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630453888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788791576.356172:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791576.356229:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc115f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630453888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791576.356237:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788791576.356502:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630453888:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788791577.254216:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788791577.657356:0:12305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 10:32:55 (1788791575) 00010000:00010000:0.0:1788791578.275403:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791579.141960:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791579.142034:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606329088 00000100:00100000:0.0:1788791579.142045:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606329088 00000100:00080000:3.0:1788791579.142105:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791579.142167:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 137 00000100:00100000:0.0:1788791579.142178:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:11300:x1875683606329088:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788791579.142213:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791579.142264:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3235fd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367516d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.142337:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323604 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.142352:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323604 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.142375:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323604 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.142390:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32360b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.142983:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32360b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.142992:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32360b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.146819:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323612 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.146842:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323612 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.146854:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323612 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791579.146867:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1788791579.147080:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323604 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.147088:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323604 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.147095:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323604 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.147102:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fee00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791579.147107:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323604 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.147115:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323604 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.147164:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ababb052400) 00010000:00010000:0.0:1788791579.147167:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791579.147172:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323604 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.147177:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323604 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.147190:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32360b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.147196:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32360b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.147203:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32360b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.147227:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791579.147230:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32360b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.147237:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32360b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.147246:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9aba94530900) 00010000:00010000:0.0:1788791579.147248:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791579.147250:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32360b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.147256:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32360b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.148061:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3235fd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367516d expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.148079:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323612 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367516d expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791579.148087:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9aba8823c000) 00010000:00010000:0.0:1788791579.148089:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791579.148092:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff000, rc 0) 00000100:00100000:0.0:1788791579.148346:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+15:11300:x1875683606329088:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 6167us (6396us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788791579.148365:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 137 00000100:00100000:0.0:1788791579.168685:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791579.168758:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791579.169187:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606329344 00000100:00100000:3.0:1788791579.169197:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606329344 00000100:00100000:3.0:1788791579.169277:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788791579.169296:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+15:2352:x1875683606329344:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791579.169312:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791579.169335:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323612 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367516d expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791579.169367:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9aba8823c000) 00010000:00010000:3.0:1788791579.169373:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791579.169935:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:2352:x1875683606329344:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 638us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791579.169945:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:1.0:1788791579.170023:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606329216 00000100:00100000:1.0:1788791579.170030:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606329216 00000100:00100000:1.0:1788791579.170073:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 138 00000100:00100000:1.0:1788791579.170082:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:11300:x1875683606329216:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788791579.170191:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:11300:x1875683606329216:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 Request processed in 110us (1520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791579.170198:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 138 00000100:00100000:3.0:1788791579.185948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791579.185999:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791579.186030:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791579.186071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791579.187794:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606329472 00000100:00100000:2.0:1788791579.187808:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606329472 00000100:00100000:2.0:1788791579.187877:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 294 00000100:00100000:2.0:1788791579.187888:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2355:x1875683606329472:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791579.187967:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2355:x1875683606329472:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 80us (2029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791579.187976:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 294 00000100:00100000:2.0:1788791579.188012:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606329856 00000100:00100000:2.0:1788791579.188017:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606329856 00000100:00100000:2.0:1788791579.188055:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 145 00000100:00100000:2.0:1788791579.188081:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28665881-f918-4421-b36a-72ee58aec27e+6:2355:x1875683606329856:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791579.188113:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28665881-f918-4421-b36a-72ee58aec27e+6:2355:x1875683606329856:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 34us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791579.188119:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 145 00000100:00080000:2.0:1788791579.188169:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791579.188914:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606329728 00000100:00100000:1.0:1788791579.188922:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606329728 00000100:00100000:1.0:1788791579.188973:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606329600 00000100:00100000:1.0:1788791579.188977:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606329600 00000100:00100000:1.0:1788791579.189001:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:1.0:1788791579.189010:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606329728:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791579.189056:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606329728:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 48us (3056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791579.189062:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:1.0:1788791579.189076:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:1.0:1788791579.189083:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2355:x1875683606329600:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791579.189106:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2355:x1875683606329600:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 24us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791579.189112:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00080000:2.0:1788791579.191338:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788791579.191349:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788791579.303263:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788791579.622183:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788791579.622196:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788791579.622243:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1788791579.622250:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788791580.324257:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788791580.483210:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:1.0:1788791580.963448:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630454016:0@lo:400:kworker.0 00000100:00100000:1.0:1788791580.963529:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791580.963776:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630454272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791580.963814:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791580.963913:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630454272 00000100:00100000:3.0:1788791580.963922:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630454272 00000100:00100000:3.0:1788791580.963987:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788791580.963996:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2c81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630454272:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788791580.964016:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1788791580.964036:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791580.964094:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2c81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630454272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791580.964101:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788791580.964202:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630454272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791580.964430:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630454016 00000100:00100000:1.0:1788791580.964448:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630454016 00000100:00100000:1.0:1788791580.964522:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788791580.964530:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3312:x1875683630454016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791580.964568:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3312:x1875683630454016:12345-0@lo:400:kworker.0 Request processed in 39us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791580.964574:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788791580.965122:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630454144:0@lo:400:kworker.0 00000100:00100000:0.0:1788791580.965174:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791580.965207:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630454656:0@lo:400:kworker.0 00000100:00100000:0.0:1788791580.965230:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791580.965265:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788791580.965271:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630454144 00000100:00100000:0.0:1788791580.965271:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630454528:0@lo:400:kworker.0 00000100:00100000:3.0:1788791580.965276:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630454144 00000100:00100000:0.0:1788791580.965307:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791580.965308:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630454656 00000100:00100000:3.0:1788791580.965310:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630454656 00000100:00100000:0.0:1788791580.965334:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630454528 00000100:00100000:3.0:1788791580.965335:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788791580.965337:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630454528 00000100:00100000:3.0:1788791580.965351:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630454144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791580.965364:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788791580.965370:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630454528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791580.965391:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630454144:12345-0@lo:400:kworker.0 Request processed in 42us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791580.965396:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630454528:12345-0@lo:400:kworker.0 Request processed in 26us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791580.965398:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788791580.965401:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788791580.965412:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788791580.965417:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630454656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791580.965429:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630454528:0@lo:400:kworker.0 00000100:00100000:0.0:1788791580.965439:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb925500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630454144:0@lo:400:kworker.0 00000100:00100000:3.0:1788791580.965442:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630454656:12345-0@lo:400:kworker.0 Request processed in 25us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791580.965447:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788791580.965447:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630454656:0@lo:400:kworker.0 00000100:00100000:2.0:1788791580.965744:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630454400:0@lo:400:kworker.0 00000100:00100000:2.0:1788791580.965899:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788791580.965931:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788791580.965935:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791580.966099:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630454400 00000100:00100000:3.0:1788791580.966104:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630454400 00000100:00100000:3.0:1788791580.966168:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788791580.966175:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630454400:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788791580.966207:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791580.966223:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875683630454400:12345-0@lo:400:kworker.0 Request processed in 49us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791580.966229:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788791580.966249:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875683630454400:0@lo:400:kworker.0 00000100:00100000:0.0:1788791580.966446:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb927800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630454016:0@lo:400:kworker.0 00000100:00100000:3.0:1788791581.276869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791581.276999:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606329984 00000100:00100000:1.0:1788791581.277009:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606329984 00000100:00100000:1.0:1788791581.277086:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 139 00000100:00100000:1.0:1788791581.277098:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:11342:x1875683606329984:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788791581.277119:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791581.277161:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a323620 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675174 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.277240:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a323627 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.277254:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a323627 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.277268:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a323627 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.277283:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32362e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.277289:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32362e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.277295:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32362e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788791581.277605:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788791581.277920:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a323627 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.277929:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a323627 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.277935:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a323627 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.277941:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791581.277945:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a323627 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.277952:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a323627 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.277964:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba94530100) 00010000:00010000:1.0:1788791581.277967:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791581.277972:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a323627 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.277979:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a323627 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.277990:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32362e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.277996:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32362e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.278002:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32362e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.278013:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01c00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791581.278016:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32362e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.278023:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32362e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.278031:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ababb052800) 00010000:00010000:1.0:1788791581.278034:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791581.278037:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32362e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.278042:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32362e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.278076:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a323620 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675174 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.278085:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba94530100) 00010000:00010000:1.0:1788791581.278087:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791581.278090:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a323620 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675174 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.278099:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c01a00, rc 0) 00000100:00100000:1.0:1788791581.278459:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:11342:x1875683606329984:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1362us (1597us total) trans 0 rc 301/301 00000100:00100000:1.0:1788791581.278467:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 139 00000100:00100000:3.0:1788791581.286317:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791581.286527:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606330240 00000100:00100000:0.0:1788791581.286537:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606330240 00000100:00100000:0.0:1788791581.286590:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 140 00000100:00100000:0.0:1788791581.286601:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:11342:x1875683606330240:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:0.0:1788791581.286657:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791581.286684:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a322f9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fad expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.286702:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba94530100) 00010000:00010000:0.0:1788791581.286707:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788791581.286969:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323635 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.286983:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a3235f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675166 expref: 5 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.286992:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323635 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.287042:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a3235f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675166 expref: 5 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.287059:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a3235f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675166 expref: 5 pid: 8351 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791581.287074:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb927800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630454784:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791581.295671:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbaaa240 going to sleep for 11 seconds 00000100:00100000:3.0:1788791581.303909:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791581.304051:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606330368 00000100:00100000:2.0:1788791581.304061:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606330368 00010000:00010000:2.0:1788791581.304111:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a3235f6 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675166 expref: 6 pid: 8351 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788791581.304331:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791581.304406:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:2.0:1788791581.304416:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28665881-f918-4421-b36a-72ee58aec27e+6:2354:x1875683606330368:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791581.304430:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791581.304437:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a3235f6 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675166 expref: 6 pid: 8351 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.304464:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a3235f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675166 expref: 6 pid: 8351 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.304485:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba94530100) 00010000:00010000:2.0:1788791581.304490:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323635 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.304498:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323635 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.304728:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323635 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.304748:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791581.304897:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28665881-f918-4421-b36a-72ee58aec27e+6:2354:x1875683606330368:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 482us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791581.304905:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00010000:00010000:1.0:1788791581.305041:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a3235f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675166 expref: 5 pid: 8351 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791581.305061:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb927800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630454784:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791581.305080:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323635 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.305089:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323635 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.305095:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323635 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.305117:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32363c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.305147:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32363c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.305155:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32363c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791581.306701:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1788791581.306716:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323635 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.306726:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323635 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.306733:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323635 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.306738:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791581.306743:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323635 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.306831:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323635 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.306847:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba94530100) 00010000:00010000:2.0:1788791581.306850:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791581.306854:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323635 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.306861:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323635 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788791581.306878:0:5836:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000169f4d29 reply state 0000000063aa4943 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32363c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791581.306887:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788791581.306956:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:11342:x1875683606330240:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 20355us (20647us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788791581.306965:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 140 00010000:00010000:1.0:1788791581.320746:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32363c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.320776:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32363c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.320784:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32363c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.320791:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00c00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791581.320796:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32363c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.320812:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32363c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.320829:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ababb052300) 00010000:00010000:1.0:1788791581.320832:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791581.320837:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32363c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.320843:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a32363c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.357707:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791581.391472:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791581.391520:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606330496 00000100:00100000:1.0:1788791581.391532:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606330496 00000100:00100000:1.0:1788791581.391594:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 141 00000100:00100000:1.0:1788791581.391605:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:11350:x1875683606330496:12345-192.168.201.29@tcp:101:lctl.0 00010000:00010000:1.0:1788791581.391635:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791581.391660:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a323643 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367517b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.391727:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a32364a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.391741:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a32364a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.391753:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a32364a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791581.391813:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788791581.391830:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791581.391863:0:5837:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a32364a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.391895:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a323643 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367517b expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.391912:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a32364a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367517b expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.391920:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ababb052300) 00010000:00010000:1.0:1788791581.391923:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788791581.391927:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c01a00, rc 0) 00000100:00100000:1.0:1788791581.391995:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:11350:x1875683606330496:12345-192.168.201.29@tcp:101:lctl.0 Request processed in 392us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791581.392003:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 141 00000100:00100000:0.0:1788791581.459882:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791581.459962:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606330624 00000100:00100000:1.0:1788791581.459973:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606330624 00000100:00100000:1.0:1788791581.460031:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 142 00000100:00100000:1.0:1788791581.460040:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:11356:x1875683606330624:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788791581.460060:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791581.460078:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a323651 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675182 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460202:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323658 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460217:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323658 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460244:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323658 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460258:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32365f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460265:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32365f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460271:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32365f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460369:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01800/0xcd6380150a323666 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460376:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01800/0xcd6380150a323666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460383:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01800/0xcd6380150a323666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791581.460410:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1788791581.460413:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791581.460431:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01800/0xcd6380150a323666 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460441:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323658 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460448:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323658 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460463:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323658 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460469:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01c00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791581.460474:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323658 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460481:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323658 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460492:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ababb052300) 00010000:00010000:1.0:1788791581.460495:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791581.460499:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323658 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460505:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323658 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460518:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32365f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460524:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32365f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460529:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32365f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460534:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791581.460537:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32365f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460550:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32365f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460557:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9ababb052800) 00010000:00010000:1.0:1788791581.460559:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791581.460562:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32365f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460567:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32365f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460593:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00c00/0xcd6380150a323651 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675182 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460605:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01800/0xcd6380150a323666 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675182 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.460612:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:1.0:1788791581.460614:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788791581.460616:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c01800, rc 0) 00000100:00100000:1.0:1788791581.460678:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+15:11356:x1875683606330624:12345-192.168.201.29@tcp:101:bash.0 Request processed in 639us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791581.460686:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 142 00000100:00100000:2.0:1788791581.470232:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791581.470517:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606330880 00000100:00100000:3.0:1788791581.470527:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606330880 00000100:00100000:3.0:1788791581.470581:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 143 00000100:00100000:3.0:1788791581.470591:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+15:11356:x1875683606330880:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1788791581.470613:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791581.470648:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32366d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675189 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.470800:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323674 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.470815:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323674 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.470828:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323674 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.470885:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32367b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.470893:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32367b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.470900:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32367b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788791581.471461:0:8351:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788791581.471615:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323682 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.471626:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.471634:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.471666:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323674 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.471682:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323674 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.471688:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323674 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.471694:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791581.471698:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323674 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.471704:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323674 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.471715:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:3.0:1788791581.471718:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791581.471722:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323674 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.471727:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323674 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788791581.471737:0:8351:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000008f563996 reply state 000000002f31cd6b transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32367b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791581.471746:0:8351:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788791581.471774:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32366d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675189 expref: 18 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.471787:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323682 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675189 expref: 17 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.471806:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba8823c600) 00010000:00010000:3.0:1788791581.471809:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788791581.471811:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d000, rc 0) 00000100:00100000:3.0:1788791581.471887:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:11356:x1875683606330880:12345-192.168.201.29@tcp:101:bash.0 Request processed in 1297us (1664us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788791581.471895:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 143 00000100:00100000:1.0:1788791581.476061:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788791581.476088:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba857b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630454912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791581.476250:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788791581.476330:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32367b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.476359:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32367b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.476367:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32367b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.476373:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791581.476379:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32367b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.476387:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32367b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.476416:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9aba8823c200) 00010000:00010000:1.0:1788791581.476420:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791581.476424:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32367b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.476429:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a32367b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791581.476464:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630454912 00000100:00100000:1.0:1788791581.476473:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630454912 00000100:00100000:1.0:1788791581.476982:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788791581.476993:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630454912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788791581.477032:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791581.477204:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc117800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630454912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 211us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791581.477212:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788791581.477409:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791581.477948:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606331008 00000100:00100000:3.0:1788791581.477955:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606331008 00000100:00100000:3.0:1788791581.478012:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:3.0:1788791581.478021:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2355:x1875683606331008:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1788791581.478033:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791581.478052:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a323690 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675190 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788791581.478078:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791581.478093:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1788791581.478097:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791581.478106:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a323690 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675190 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.478123:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a323690 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675190 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.478171:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c800, rc 0) 00000100:00100000:3.0:1788791581.478231:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc115880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606331008:12345-192.168.201.29@tcp:101:bash.0 Request processed in 212us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791581.478246:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:2.0:1788791581.478359:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba857b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630454912:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788791581.479933:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788791581.482490:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791581.482639:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606331136 00000100:00100000:0.0:1788791581.482649:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606331136 00000100:00100000:0.0:1788791581.482707:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:0.0:1788791581.482717:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:11356:x1875683606331136:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1788791581.482735:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791581.482875:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323697 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675197 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.482907:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a323690 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675190 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.482916:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791581.482921:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791581.482926:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323697 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675197 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.482960:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a323690 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675190 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.482973:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a323690 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675190 expref: 7 pid: 6682 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791581.482987:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb925180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6683:1875683630455040:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791581.483569:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbaaa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791581.493895:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb925180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6683:1875683630455040:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788791581.493930:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323697 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675197 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.493950:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff200, rc 0) 00000100:00100000:0.0:1788791581.494014:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:11356:x1875683606331136:12345-192.168.201.29@tcp:101:bash.0 Request processed in 11298us (11533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791581.494023:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:1.0:1788791581.497545:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791581.498328:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606331264 00000100:00100000:2.0:1788791581.498340:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606331264 00010000:00010000:2.0:1788791581.498386:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a323690 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675190 expref: 7 pid: 6682 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791581.498431:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:2.0:1788791581.498440:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc114e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2354:x1875683606331264:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791581.498470:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791581.498493:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a323690 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675190 expref: 7 pid: 6682 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.498507:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a323690 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675190 expref: 7 pid: 6682 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.498531:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d3c784d/0xcd6380150a323690 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675190 expref: 7 pid: 6682 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.498549:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791581.498554:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791581.498562:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323697 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675197 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.498572:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323697 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675197 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.498606:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323697 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675197 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791581.498621:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc008a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1875683630455168:192.168.201.29@tcp:105: 00000100:00100000:2.0:1788791581.502799:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba84d0fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791581.506889:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc008a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1875683630455168:192.168.201.29@tcp:105: 00010000:00010000:2.0:1788791581.506916:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791581.506981:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc114e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2354:x1875683606331264:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 8541us (9446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791581.506992:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:2.0:1788791581.507461:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791581.507612:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606331520 00000100:00100000:1.0:1788791581.507619:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606331520 00000100:00100000:1.0:1788791581.507663:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:1.0:1788791581.507672:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+17:11356:x1875683606331520:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:1.0:1788791581.508104:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:11356:x1875683606331520:12345-192.168.201.29@tcp:35:bash.0 Request processed in 432us (643us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788791581.508112:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:1.0:1788791581.607910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791581.608019:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606331776 00000100:00100000:0.0:1788791581.608029:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606331776 00000100:00100000:0.0:1788791581.608096:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 144 00000100:00100000:0.0:1788791581.608106:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:11366:x1875683606331776:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791581.608171:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791581.608204:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32369e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367519e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791581.608328:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1788791581.608449:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32369e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367519e expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.608476:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ababb052300) 00010000:00010000:0.0:1788791581.608479:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788791581.608484:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a32369e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367519e expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.608498:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ffc00, rc 0) 00000100:00100000:0.0:1788791581.608572:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc114a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+19:11366:x1875683606331776:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 467us (673us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788791581.608594:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 144 00000100:00100000:2.0:1788791581.621387:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791581.621572:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606332032 00000100:00100000:1.0:1788791581.621583:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606332032 00000100:00100000:1.0:1788791581.621699:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:1.0:1788791581.621710:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+19:11366:x1875683606332032:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788791581.621991:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+20:11366:x1875683606332032:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 283us (616us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788791581.621997:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:3.0:1788791581.713279:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791581.713387:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606332160 00000100:00100000:1.0:1788791581.713396:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606332160 00000100:00100000:1.0:1788791581.713457:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 145 00000100:00100000:1.0:1788791581.713468:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+20:11372:x1875683606332160:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788791581.713510:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791581.713532:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a3236ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536751a5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.713601:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3236b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.713628:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3236b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.713641:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3236b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791581.713702:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1788791581.713704:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791581.713723:0:5837:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3236b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.713747:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a3236ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751a5 expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.713766:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3236b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751a5 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.713775:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:1.0:1788791581.713794:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788791581.713798:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c01000, rc 0) 00000100:00100000:1.0:1788791581.713864:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+21:11372:x1875683606332160:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 399us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791581.713872:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 145 00000100:00100000:2.0:1788791581.718764:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791581.719008:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606332416 00000100:00100000:0.0:1788791581.719020:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606332416 00000100:00100000:0.0:1788791581.719082:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 146 00000100:00100000:0.0:1788791581.719092:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc00a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+21:11372:x1875683606332416:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791581.719115:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791581.719314:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a3236ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536751ac expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.719418:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3236c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.719432:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3236c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.719444:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3236c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791581.719454:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788791581.719717:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a3236ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751ac expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.719736:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3236c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751ac expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.720107:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba8823c600) 00010000:00010000:0.0:1788791581.720111:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788791581.720115:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fea00, rc 0) 00000100:00100000:0.0:1788791581.720249:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc00a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+23:11372:x1875683606332416:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1157us (1501us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788791581.720256:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 146 00000100:00100000:2.0:1788791581.723718:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791581.723810:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606332800 00000100:00100000:1.0:1788791581.723821:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606332800 00000100:00100000:1.0:1788791581.723889:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:1.0:1788791581.723899:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+23:2352:x1875683606332800:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791581.723914:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791581.723953:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3236c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751ac expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.723973:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba8823c600) 00010000:00010000:1.0:1788791581.723978:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791581.724039:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+22:2352:x1875683606332800:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 142us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791581.724047:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1788791581.725854:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791581.725929:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606332672 00000100:00100000:1.0:1788791581.725938:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606332672 00000100:00100000:1.0:1788791581.725989:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 147 00000100:00100000:1.0:1788791581.725999:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba857b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+22:11372:x1875683606332672:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788791581.726024:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791581.726044:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a3236cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536751b3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.727252:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a3236d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.727271:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a3236d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.727281:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a3236d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791581.727294:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788791581.727419:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a3236cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751b3 expref: 25 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.727454:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a3236d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751b3 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.727463:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba8823c600) 00010000:00010000:1.0:1788791581.727466:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788791581.727469:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c01e00, rc 0) 00000100:00100000:1.0:1788791581.727577:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba857b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+24:11372:x1875683606332672:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1578us (1729us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1788791581.727585:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 147 00000100:00100000:3.0:1788791581.733320:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791581.733414:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606332928 00000100:00100000:1.0:1788791581.733425:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606332928 00000100:00100000:1.0:1788791581.733527:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:1.0:1788791581.733538:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606332928:12345-192.168.201.29@tcp:1:lfs.0 00010000:00010000:1.0:1788791581.733584:0:10087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009304331c/0xcd6380150a3236e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.733605:0:10087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323697 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675197 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.733614:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788791581.733618:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788791581.733624:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009304331c/0xcd6380150a3236e4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.733659:0:10087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323697 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675197 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.733689:0:10087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323697 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675197 expref: 6 pid: 6683 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791581.733706:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc114380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10087:1875683630455296:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791581.733973:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98da6300 going to sleep for 11 seconds 00000100:00100000:0.0:1788791581.736986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791581.737059:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606333056 00000100:00100000:3.0:1788791581.737069:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606333056 00002000:00100000:3.0:1788791581.737123:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ababb925180 x1875683606333056/t0(0) o4->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:292/0 lens 504/0 e 0 to 0 dl 1788791592 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788791581.737154:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ababb925180 with x1875683606333056 ext(0->12) 00010000:00010000:3.0:1788791581.737164:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323697 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675197 expref: 7 pid: 6683 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.737192:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323697 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675197 expref: 7 pid: 6683 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788791581.737200:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ababb925180 00000100:00100000:3.0:1788791581.737231:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:3.0:1788791581.737242:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2354:x1875683606333056:12345-192.168.201.29@tcp:4:lfs.0 00000100:00100000:3.0:1788791581.738046:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb925180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2354:x1875683606333056:12345-192.168.201.29@tcp:4:lfs.0 Request processed in 803us (1068us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788791581.738056:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00002000:00100000:3.0:1788791581.738064:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9ababb925180 x1875683606333056/t4294967305(0) o4->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:292/0 lens 504/448 e 0 to 0 dl 1788791592 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788791581.738073:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ababb925180 with x1875683606333056 ext(0->12) 00010000:00010000:3.0:1788791581.738087:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323697 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675197 expref: 9 pid: 6683 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.738101:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323697 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675197 expref: 9 pid: 6683 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788791581.738108:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ababb925180 00000100:00100000:1.0:1788791581.738245:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc114380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10087:1875683630455296:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791581.738267:0:10087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009304331c/0xcd6380150a3236e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791581.741030:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791581.741121:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606333184 00000100:00100000:3.0:1788791581.741213:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606333184 00010000:00010000:3.0:1788791581.741255:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323697 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675197 expref: 9 pid: 6683 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791581.741336:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:3.0:1788791581.741347:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2353:x1875683606333184:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791581.741362:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788791581.741381:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788791581.741384:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788791581 00002000:00010000:3.0:1788791581.741386:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788791581 00002000:00010000:3.0:1788791581.741388:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788791581 00010000:00010000:3.0:1788791581.741393:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323697 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675197 expref: 9 pid: 6683 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.741406:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323697 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675197 expref: 9 pid: 6683 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.741430:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323697 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675197 expref: 9 pid: 6683 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.741467:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788791581.741472:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788791581.741479:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009304331c/0xcd6380150a3236e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.741497:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009304331c/0xcd6380150a3236e4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.741535:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791581.741595:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2353:x1875683606333184:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 249us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791581.741604:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 63 00010000:00010000:1.0:1788791581.741657:0:10087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009304331c/0xcd6380150a3236e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.741666:0:10087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009304331c/0xcd6380150a3236e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.741690:0:10087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009304331c/0xcd6380150a3236e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.741698:0:10087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009304331c/0xcd6380150a3236e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.741705:0:10087:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009304331c/0xcd6380150a3236e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.741724:0:10087:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00a00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791581.741728:0:10087:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009304331c/0xcd6380150a3236e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.741737:0:10087:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009304331c/0xcd6380150a3236e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.741757:0:10087:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009304331c/0xcd6380150a3236e4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.741764:0:10087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009304331c/0xcd6380150a3236e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791581.741810:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb785c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2355:x1875683606332928:12345-192.168.201.29@tcp:1:lfs.0 Request processed in 8274us (8499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791581.741818:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:2.0:1788791581.744812:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791581.744923:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606333440 00000100:00100000:0.0:1788791581.744934:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606333440 00000100:00100000:0.0:1788791581.745028:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:0.0:1788791581.745039:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99280850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+24:11372:x1875683606333440:12345-192.168.201.29@tcp:35:lfs.0 00000004:00010000:0.0:1788791581.745107:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a3236d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751b3 expref: 24 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788791581.745386:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788791581.745431:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788791581.746154:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1788791581.746226:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3236eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.746241:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323682 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675189 expref: 28 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.746250:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3236eb lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.746288:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323682 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675189 expref: 28 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.746304:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323682 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675189 expref: 28 pid: 8351 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791581.746332:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb925500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875683630455424:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791581.746433:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbaaab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788791581.749069:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791581.749113:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606333568 00000100:00100000:2.0:1788791581.749122:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606333568 00010000:00010000:2.0:1788791581.749191:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323682 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675189 expref: 29 pid: 8351 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791581.749225:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:2.0:1788791581.749235:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa001f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+29:2354:x1875683606333568:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791581.749249:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791581.749256:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323682 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675189 expref: 29 pid: 8351 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.749269:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323682 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675189 expref: 29 pid: 8351 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.749289:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba8823c600) 00010000:00010000:2.0:1788791581.749294:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3236eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.749319:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3236eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.749326:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3236eb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791581.749344:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791581.749390:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa001f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+29:2354:x1875683606333568:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 156us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791581.749398:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 64 00010000:00010000:3.0:1788791581.749612:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323682 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675189 expref: 28 pid: 8351 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791581.749629:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb925500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875683630455424:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791581.749645:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3236eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.749654:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3236eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.749659:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3236eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788791581.749791:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788791581.749990:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1788791581.750087:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb786d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875683630455552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788791581.750154:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791581.750188:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab78da000 going to sleep for 11 seconds 00000100:00100000:3.0:1788791581.750207:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630455552 00000100:00100000:3.0:1788791581.750212:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630455552 00000100:00100000:3.0:1788791581.750256:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788791581.750264:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875683630455552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788791581.750343:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875683630455552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 79us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791581.750350:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788791581.750379:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb786d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875683630455552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788791581.750779:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788791581.750831:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfd9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875683630455680:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788791581.750857:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791581.750873:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab78da600 going to sleep for 11 seconds 00000100:00100000:3.0:1788791581.750885:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630455680 00000100:00100000:3.0:1788791581.750888:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630455680 00000100:00100000:3.0:1788791581.750904:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788791581.750909:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875683630455680:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788791581.751017:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875683630455680:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 107us (159us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788791581.751024:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788791581.751052:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfd9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875683630455680:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788791581.751089:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1788791581.751117:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3236eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.751153:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3236eb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.751160:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3236eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.751166:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791581.751180:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3236eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.751188:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3236eb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.751200:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba8823c600) 00010000:00010000:3.0:1788791581.751203:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788791581.751207:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3236eb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791581.751213:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3236eb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788791581.751358:0:5841:0:(mdd_object.c:4131:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788791581.751473:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788791581.751484:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358131356262ns, next at 359131354236ns, rc = 0 00000001:00080000:3.0:1788791581.751490:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788791581.751533:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba8823c600) 00010000:00010000:3.0:1788791581.751536:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788791581.751545:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a3236d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751b3 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791581.751632:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99280850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+31:11372:x1875683606333440:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 6594us (6893us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1788791581.751639:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00000020:00080000:3.0:1788791581.751643:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788791581.755281:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791581.755383:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606333696 00000100:00100000:0.0:1788791581.755394:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606333696 00000100:00100000:0.0:1788791581.755491:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 148 00000100:00100000:0.0:1788791581.755623:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+31:11372:x1875683606333696:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791581.755648:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791581.755673:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3236f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536751ba expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.755726:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3236f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751ba expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.755741:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3236f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751ba expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791581.755831:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:0.0:1788791581.755834:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788791581.755838:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff600, rc 0) 00000100:00100000:0.0:1788791581.755942:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+32:11372:x1875683606333696:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 440us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791581.755950:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 148 00000100:00100000:2.0:1788791581.758696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791581.758785:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606333952 00000100:00100000:1.0:1788791581.758795:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606333952 00000100:00100000:1.0:1788791581.758849:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:1.0:1788791581.758859:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+32:11372:x1875683606333952:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788791581.759077:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+33:11372:x1875683606333952:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 218us (390us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788791581.759084:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:2.0:1788791581.845451:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791581.845569:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606334208 00000100:00100000:1.0:1788791581.845595:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606334208 00000100:00100000:1.0:1788791581.845660:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 149 00000100:00100000:1.0:1788791581.845671:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+33:11382:x1875683606334208:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788791581.845697:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791581.845719:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a3236f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536751c1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791581.845851:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1788791581.845975:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a3236f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751c1 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.845990:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ababb052300) 00010000:00010000:1.0:1788791581.845993:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788791581.845998:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a3236f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751c1 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.846013:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c00a00, rc 0) 00000100:00100000:1.0:1788791581.846076:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+34:11382:x1875683606334208:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 407us (633us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1788791581.846084:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 149 00000100:00100000:2.0:1788791581.850106:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791581.850250:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606334336 00000100:00100000:1.0:1788791581.850259:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606334336 00000100:00100000:1.0:1788791581.850313:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 150 00000100:00100000:1.0:1788791581.850322:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+34:11382:x1875683606334336:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:1.0:1788791581.850394:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323707 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850408:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323707 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850431:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323707 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850445:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a32370e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850463:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a32370e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850470:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a32370e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850566:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a323715 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850574:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a323715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850581:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a323715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788791581.850617:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a323715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850628:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323707 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850635:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323707 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850642:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323707 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850658:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01c00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791581.850663:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323707 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850671:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323707 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850681:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:1.0:1788791581.850684:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791581.850688:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323707 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850694:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323707 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850705:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a32370e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850711:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a32370e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850717:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a32370e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850722:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791581.850725:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a32370e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850730:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a32370e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850756:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ababb052800) 00010000:00010000:1.0:1788791581.850758:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791581.850761:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a32370e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850767:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a32370e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850780:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a323715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850785:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a323715 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850791:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a323715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850796:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791581.850799:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a323715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850805:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a323715 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850811:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:1.0:1788791581.850813:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791581.850815:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a323715 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.850821:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a323715 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791581.850902:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+34:11382:x1875683606334336:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 580us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791581.850910:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 150 00000100:00100000:2.0:1788791581.853522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791581.853600:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606334592 00000100:00100000:1.0:1788791581.853611:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606334592 00000100:00100000:1.0:1788791581.853666:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:1.0:1788791581.853676:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+34:11382:x1875683606334592:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788791581.853934:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+35:11382:x1875683606334592:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 258us (419us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788791581.853941:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:3.0:1788791581.903702:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791581.903936:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606334848 00000100:00100000:1.0:1788791581.903947:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606334848 00000100:00100000:1.0:1788791581.904020:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 151 00000100:00100000:1.0:1788791581.904031:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+35:11385:x1875683606334848:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788791581.904052:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791581.904072:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32371c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536751c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904199:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323723 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904214:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323723 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904223:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323723 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904256:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32372a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904263:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32372a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904270:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32372a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904396:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a323731 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904404:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a323731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904412:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a323731 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791581.904421:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788791581.904532:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323723 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904539:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323723 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904545:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323723 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904550:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791581.904555:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323723 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904573:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323723 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904585:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:1.0:1788791581.904588:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791581.904593:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323723 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904599:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323723 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904611:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32372a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904616:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32372a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904622:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32372a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904627:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01c00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791581.904629:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32372a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904634:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32372a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904640:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ababb052800) 00010000:00010000:1.0:1788791581.904642:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791581.904644:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32372a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904659:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32372a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904705:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32371c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751c8 expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904718:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a323731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751c8 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.904725:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:1.0:1788791581.904727:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788791581.904730:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c00a00, rc 0) 00000100:00100000:0.0:1788791581.907221:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+37:11385:x1875683606334848:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 3181us (3519us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788791581.907235:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 151 00000100:00100000:2.0:1788791581.911299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791581.911381:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606334976 00000100:00100000:1.0:1788791581.911391:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606334976 00000100:00100000:1.0:1788791581.911448:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 152 00000100:00100000:1.0:1788791581.911467:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+37:11385:x1875683606334976:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:1.0:1788791581.911550:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32373f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.911566:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32373f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.911577:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32373f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.911605:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32373f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.911612:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32373f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.911634:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32373f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.911641:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791581.911646:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32373f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.911654:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32373f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.911665:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:1.0:1788791581.911669:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788791581.911673:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32373f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791581.911680:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32373f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791581.911764:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+37:11385:x1875683606334976:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 299us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791581.911772:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 152 00000100:00100000:2.0:1788791581.914612:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791581.914880:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606335232 00000100:00100000:1.0:1788791581.914890:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606335232 00000100:00100000:1.0:1788791581.914948:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:1.0:1788791581.914959:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+37:11385:x1875683606335232:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788791581.915223:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+38:11385:x1875683606335232:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 266us (620us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788791581.915230:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:0.0:1788791582.260036:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791582.260146:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606335488 00000100:00100000:3.0:1788791582.260156:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606335488 00000100:00100000:3.0:1788791582.260414:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 153 00000100:00100000:3.0:1788791582.260426:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+38:11416:x1875683606335488:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:3.0:1788791582.260450:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791582.260469:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323746 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536751cf expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791582.260902:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32374d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791582.260920:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32374d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791582.260932:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32374d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791582.260943:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788791582.261069:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323746 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751cf expref: 41 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791582.261087:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32374d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751cf expref: 40 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791582.261110:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:3.0:1788791582.261113:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788791582.261117:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16da00, rc 0) 00000100:00100000:3.0:1788791582.261447:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+40:11416:x1875683606335488:12345-192.168.201.29@tcp:101:cat.0 Request processed in 1023us (1420us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788791582.261455:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 153 00000100:00100000:0.0:1788791582.274765:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791582.274862:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791582.275021:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606335872 00000100:00100000:1.0:1788791582.275031:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606335872 00000100:00100000:1.0:1788791582.275089:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:1.0:1788791582.275100:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+40:11416:x1875683606335872:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:1.0:1788791582.275389:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+41:11416:x1875683606335872:12345-192.168.201.29@tcp:35:cat.0 Request processed in 289us (525us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788791582.275398:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:2.0:1788791582.275586:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606335616 00000100:00100000:2.0:1788791582.275591:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606335616 00000100:00100000:2.0:1788791582.275637:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1788791582.275645:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+41:2352:x1875683606335616:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791582.275656:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791582.275679:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a32374d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751cf expref: 41 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.275696:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:2.0:1788791582.275701:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791582.275735:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb927480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+40:2352:x1875683606335616:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 91us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791582.275743:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:0.0:1788791582.362625:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791582.363025:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606336128 00000100:00100000:1.0:1788791582.363036:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606336128 00000100:00100000:1.0:1788791582.363096:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 154 00000100:00100000:1.0:1788791582.363106:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+40:11423:x1875683606336128:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:1.0:1788791582.363261:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791582.363265:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788791582.363292:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3236b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751a5 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791582.363312:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:1.0:1788791582.363317:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788791582.363330:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32375b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536751d6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791582.363445:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323762 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791582.363459:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a323731 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751c8 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791582.364376:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323762 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791582.364427:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a323731 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751c8 expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791582.364442:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a323731 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751c8 expref: 40 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791582.364457:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc114380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875683630455808:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791582.365463:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98da6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788791582.366709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791582.368436:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606336256 00000100:00100000:2.0:1788791582.368461:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606336256 00010000:00010000:2.0:1788791582.368517:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a323731 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751c8 expref: 41 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791582.368564:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:2.0:1788791582.368574:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb927800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+41:2354:x1875683606336256:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791582.368587:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791582.368595:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a323731 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751c8 expref: 41 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.368609:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a323731 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751c8 expref: 41 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.368630:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:2.0:1788791582.368635:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323762 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.368644:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323762 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.368651:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323762 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.368671:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791582.368745:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb927800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+41:2354:x1875683606336256:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 172us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791582.368764:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 65 00010000:00010000:1.0:1788791582.369084:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a323731 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751c8 expref: 40 pid: 5837 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791582.369102:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc114380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875683630455808:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791582.369122:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323762 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791582.369170:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323762 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791582.369177:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323762 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791582.369195:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788791582.369349:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a32375b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751d6 expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791582.369364:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323762 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751d6 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791582.369385:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:1.0:1788791582.369388:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788791582.369391:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c01600, rc 0) 00000100:00100000:1.0:1788791582.369419:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+40:11423:x1875683606336128:12345-192.168.201.29@tcp:101:dd.0 Request processed in 6315us (6804us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788791582.369426:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 154 00010000:00010000:1.0:1788791582.372450:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791582.372810:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791582.372960:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606336512 00000100:00100000:2.0:1788791582.372971:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606336512 00000100:00100000:2.0:1788791582.373025:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 155 00000100:00100000:2.0:1788791582.373036:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+40:11423:x1875683606336512:12345-192.168.201.29@tcp:36:dd.0 00010000:00010000:2.0:1788791582.373337:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323770 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.373354:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323770 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.373364:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323770 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788791582.373410:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788791582.373431:0:5837:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000018719133 reply state 00000000fb793d02 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323770 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791582.373439:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788791582.373703:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+43:11423:x1875683606336512:12345-192.168.201.29@tcp:36:dd.0 Request processed in 667us (897us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788791582.373711:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 155 00000020:00080000:2.0:1788791582.373715:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788791582.375337:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323770 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791582.375353:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323770 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791582.375361:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323770 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791582.375366:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81be00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791582.375370:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323770 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791582.375378:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323770 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791582.375392:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:1.0:1788791582.375395:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791582.375400:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323770 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791582.375405:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323770 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791582.797583:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791582.797678:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606336640 00000100:00100000:2.0:1788791582.797688:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606336640 00000100:00100000:2.0:1788791582.797749:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 156 00000100:00100000:2.0:1788791582.797759:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+42:11437:x1875683606336640:12345-192.168.201.29@tcp:101:stat.0 00010000:00010000:2.0:1788791582.797781:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791582.797814:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323777 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536751dd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.797879:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32377e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.797893:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32377e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.797906:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32377e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.797921:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323785 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.797928:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.797935:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.798042:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32378c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.798052:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323762 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751d6 expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.798060:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32378c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.798090:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323762 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751d6 expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.798113:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323762 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751d6 expref: 43 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791582.798162:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2e08a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630455936:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788791582.798260:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba84d0fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788791582.801882:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2e08a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630455936:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791582.801909:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32378c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791582.806420:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791582.806546:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606336896 00000100:00100000:0.0:1788791582.806556:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606336896 00000100:00100000:0.0:1788791582.806625:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:0.0:1788791582.806636:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+44:5595:x1875683606336896:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788791582.806948:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+45:5595:x1875683606336896:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 312us (535us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1788791582.806956:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:0.0:1788791582.812329:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791582.812451:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606337024 00000100:00100000:2.0:1788791582.812461:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606337024 00010000:00010000:2.0:1788791582.812513:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323762 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751d6 expref: 45 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791582.812597:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:2.0:1788791582.812609:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+45:2355:x1875683606337024:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791582.812623:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791582.812630:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323762 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751d6 expref: 45 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.812645:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323762 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751d6 expref: 45 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.812668:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323762 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751d6 expref: 45 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.812702:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:2.0:1788791582.812707:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32378c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.812718:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32378c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.812726:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32378c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.812759:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791582.812817:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+44:2355:x1875683606337024:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 211us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791582.812825:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 66 00010000:00010000:0.0:1788791582.812879:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32378c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.812888:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32378c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791582.812933:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788791582.812937:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791582.812955:0:5836:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32378c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.812965:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32378c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.812974:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32377e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.812989:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32377e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.812995:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32377e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.813000:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791582.813004:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32377e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.813010:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32377e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.813019:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:0.0:1788791582.813022:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791582.813025:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32377e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.813031:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a32377e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.813042:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.813047:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323785 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.813053:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.813058:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791582.813067:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.813074:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323785 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.813082:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9aba8533f000) 00010000:00010000:0.0:1788791582.813085:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791582.813089:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323785 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.813094:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323785 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.813185:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323777 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751dd expref: 44 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.813200:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32378c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751dd expref: 43 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791582.813208:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:0.0:1788791582.813210:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788791582.813212:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81be00, rc 0) 00000100:00100000:0.0:1788791582.813238:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb786d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+43:11437:x1875683606336640:12345-192.168.201.29@tcp:101:stat.0 Request processed in 15480us (15666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791582.813244:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 156 00000100:00100000:2.0:1788791582.873931:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791582.874000:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606337280 00000100:00100000:3.0:1788791582.874011:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606337280 00000100:00100000:3.0:1788791582.874067:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 157 00000100:00100000:3.0:1788791582.874077:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+43:11443:x1875683606337280:12345-192.168.201.29@tcp:36:truncate.0 00010000:00010000:3.0:1788791582.874175:0:8351:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791582.874202:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a32378c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751dd expref: 43 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791582.874223:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:3.0:1788791582.874228:0:8351:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788791582.874431:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323793 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791582.874446:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791582.874457:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788791582.874525:0:8351:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788791582.874550:0:8351:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000006f3e76e5 reply state 000000003f4376f6 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791582.874559:0:8351:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788791582.874734:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+45:11443:x1875683606337280:12345-192.168.201.29@tcp:36:truncate.0 Request processed in 657us (809us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788791582.874742:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 157 00000020:00080000:3.0:1788791582.874747:0:8351:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788791582.888795:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.888812:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323793 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.888831:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323793 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.888837:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791582.888842:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323793 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.888851:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323793 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.888883:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:2.0:1788791582.888886:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791582.888891:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323793 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791582.888897:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323793 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791583.043041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791583.043204:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606337408 00000100:00100000:1.0:1788791583.043215:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606337408 00000100:00100000:1.0:1788791583.043324:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 158 00000100:00100000:1.0:1788791583.043336:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+44:11457:x1875683606337408:12345-192.168.201.29@tcp:101:stat.0 00010000:00010000:1.0:1788791583.043360:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791583.043380:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a32379a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536751e4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043442:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043456:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043484:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043499:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3237a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043506:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3237a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043512:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3237a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043609:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a3237af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043617:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a3237af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043639:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a3237af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791583.043686:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788791583.043690:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791583.043714:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a3237af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043733:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a3237af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043741:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043748:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043755:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043761:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791583.043766:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043773:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043783:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:1.0:1788791583.043786:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791583.043791:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043807:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043822:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3237a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043827:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3237a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043832:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3237a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043836:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00e00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791583.043839:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3237a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043844:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3237a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043851:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ababb052800) 00010000:00010000:1.0:1788791583.043853:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791583.043855:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3237a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043860:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a3237a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043886:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a32379a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751e4 expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043897:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a3237af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751e4 expref: 45 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.043908:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:1.0:1788791583.043911:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788791583.043914:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c00000, rc 0) 00000100:00100000:1.0:1788791583.044075:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+45:11457:x1875683606337408:12345-192.168.201.29@tcp:101:stat.0 Request processed in 740us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791583.044082:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 158 00000100:00080000:3.0:1788791583.044592:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791583.149489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791583.149891:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606337664 00000100:00100000:3.0:1788791583.149903:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606337664 00000100:00100000:3.0:1788791583.150012:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 159 00000100:00100000:3.0:1788791583.150022:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+45:11467:x1875683606337664:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788791583.150043:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791583.150062:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3237b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536751eb expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791583.150207:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1788791583.150313:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3237b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751eb expref: 47 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791583.150328:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ababb052300) 00010000:00010000:3.0:1788791583.150331:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788791583.150336:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3237b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751eb expref: 47 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791583.150366:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c000, rc 0) 00000100:00100000:3.0:1788791583.150432:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc114380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+46:11467:x1875683606337664:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 411us (963us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1788791583.150439:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 159 00000100:00100000:2.0:1788791583.159023:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.161628:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606337920 00000100:00100000:0.0:1788791583.161656:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606337920 00000100:00100000:0.0:1788791583.161734:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:0.0:1788791583.161746:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99281850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+46:11467:x1875683606337920:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1788791583.162305:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99281850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+47:11467:x1875683606337920:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 560us (3290us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788791583.162314:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:0.0:1788791583.222091:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791583.222237:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606338176 00000100:00100000:2.0:1788791583.222247:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606338176 00000100:00100000:2.0:1788791583.222314:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 160 00000100:00100000:2.0:1788791583.222325:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+47:11473:x1875683606338176:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788791583.222351:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791583.222371:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a3237c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536751f2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.222474:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3237cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.222489:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a3237af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751e4 expref: 48 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.222497:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3237cb lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.222546:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a3237af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751e4 expref: 48 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.222576:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a3237af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751e4 expref: 48 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791583.222590:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2e09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630456064:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788791583.222683:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba84d0fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788791583.225253:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2e09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630456064:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791583.225285:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3237cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791583.226454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791583.231033:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606338304 00000100:00100000:2.0:1788791583.231047:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606338304 00010000:00010000:2.0:1788791583.231095:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a3237af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751e4 expref: 49 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791583.231217:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 67 00000100:00100000:2.0:1788791583.231227:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+49:2355:x1875683606338304:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791583.231241:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791583.231248:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a3237af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751e4 expref: 49 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.231262:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a3237af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751e4 expref: 49 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.231282:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a3237af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751e4 expref: 49 pid: 5839 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.231317:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:2.0:1788791583.231322:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3237cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.231332:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3237cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.231339:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3237cb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.231369:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791583.231441:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+48:2355:x1875683606338304:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 214us (4992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791583.231448:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 67 00010000:00010000:0.0:1788791583.233163:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3237cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.233178:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3237cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791583.233200:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788791583.233354:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a3237c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751f2 expref: 49 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.233372:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3237cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751f2 expref: 48 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.233380:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:0.0:1788791583.233383:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788791583.233386:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81b400, rc 0) 00000100:00100000:0.0:1788791583.233440:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+48:11473:x1875683606338176:12345-192.168.201.29@tcp:101:bash.0 Request processed in 11117us (11359us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788791583.233448:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 160 00000100:00100000:0.0:1788791583.237880:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791583.237958:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606338560 00000100:00100000:2.0:1788791583.237968:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606338560 00000100:00100000:2.0:1788791583.238022:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 161 00000100:00100000:2.0:1788791583.238032:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+48:11473:x1875683606338560:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:2.0:1788791583.238332:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3237d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.238350:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3237d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.238362:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3237d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788791583.238411:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788791583.238434:0:5837:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000002e08365d reply state 00000000b57d25a0 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3237d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791583.238458:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788791583.238537:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+51:11473:x1875683606338560:12345-192.168.201.29@tcp:36:bash.0 Request processed in 506us (665us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788791583.238544:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 161 00000020:00080000:2.0:1788791583.238549:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788791583.241671:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3237d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791583.241689:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3237d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791583.241697:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3237d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791583.241702:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81ba00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791583.241707:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3237d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791583.241715:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3237d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791583.241737:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:3.0:1788791583.241740:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791583.241744:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3237d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791583.241750:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3237d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791583.251977:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791583.252192:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606338688 00000100:00100000:1.0:1788791583.252203:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606338688 00000100:00100000:1.0:1788791583.252266:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 162 00000100:00100000:1.0:1788791583.252277:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+50:11473:x1875683606338688:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788791583.252303:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791583.252324:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a3237e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536751f9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.252411:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.252425:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3237cb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751f2 expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.252434:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237e7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.252479:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3237cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751f2 expref: 51 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.252511:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3237cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751f2 expref: 51 pid: 5836 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791583.252527:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc117b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875683630456192:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791583.252615:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98da6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788791583.258967:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.259976:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc117b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875683630456192:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788791583.260032:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791583.264666:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606338816 00000100:00100000:3.0:1788791583.264698:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606338816 00010000:00010000:3.0:1788791583.264860:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3237cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751f2 expref: 52 pid: 5836 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791583.264964:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:3.0:1788791583.264975:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc115f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:2355:x1875683606338816:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791583.265000:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791583.265007:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3237cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751f2 expref: 52 pid: 5836 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791583.265022:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3237cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751f2 expref: 52 pid: 5836 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791583.265042:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3237cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536751f2 expref: 52 pid: 5836 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791583.265059:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:3.0:1788791583.265065:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791583.265074:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791583.265081:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237e7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791583.265110:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791583.265220:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc115f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+51:2355:x1875683606338816:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 247us (6263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791583.265237:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 68 00010000:00010000:0.0:1788791583.266220:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.266233:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791583.266280:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788791583.266284:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791583.266302:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.266334:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a3237e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751f9 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.266350:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751f9 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.266358:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:0.0:1788791583.266361:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788791583.266363:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c01000, rc 0) 00000100:00100000:0.0:1788791583.266409:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+50:11473:x1875683606338688:12345-192.168.201.29@tcp:101:bash.0 Request processed in 14135us (14441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791583.266417:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 162 00000100:00100000:2.0:1788791583.273087:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791583.274249:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606339072 00000100:00100000:1.0:1788791583.274262:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606339072 00000100:00100000:1.0:1788791583.274331:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:1.0:1788791583.274341:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+50:11473:x1875683606339072:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:1.0:1788791583.274580:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+51:11473:x1875683606339072:12345-192.168.201.29@tcp:35:bash.0 Request processed in 239us (1502us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788791583.274588:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:2.0:1788791583.363247:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.363508:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606339328 00000100:00100000:0.0:1788791583.363520:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606339328 00000100:00100000:0.0:1788791583.363581:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 163 00000100:00100000:0.0:1788791583.363592:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+51:11483:x1875683606339328:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791583.363631:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791583.363654:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a3237ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675200 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791583.363780:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1788791583.363896:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a3237ee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675200 expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.363912:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ababb052300) 00010000:00010000:0.0:1788791583.363915:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788791583.363919:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a3237ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675200 expref: 53 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.363933:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ffc00, rc 0) 00000100:00100000:0.0:1788791583.364005:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:11483:x1875683606339328:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 414us (766us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788791583.364012:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 163 00000100:00100000:3.0:1788791583.366913:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.367010:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606339456 00000100:00100000:0.0:1788791583.367020:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606339456 00000100:00100000:0.0:1788791583.367164:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 164 00000100:00100000:0.0:1788791583.367174:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:11483:x1875683606339456:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:0.0:1788791583.367252:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3237fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367267:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3237fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367278:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3237fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367305:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323803 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367312:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367318:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367420:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32380a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367429:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32380a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367436:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32380a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788791583.367489:0:5836:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32380a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367502:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3237fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367509:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3237fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367516:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3237fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367523:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fea00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791583.367527:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3237fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367541:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3237fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367554:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:0.0:1788791583.367557:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791583.367562:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3237fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367568:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3237fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367581:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367588:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323803 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367594:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367598:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ffa00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791583.367600:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367606:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323803 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367613:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9aba94530b00) 00010000:00010000:0.0:1788791583.367615:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791583.367618:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323803 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367633:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323803 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367648:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32380a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367654:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32380a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367660:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32380a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367664:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791583.367667:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32380a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367673:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32380a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367680:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:0.0:1788791583.367682:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791583.367685:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32380a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.367690:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32380a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791583.367771:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:11483:x1875683606339456:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 597us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791583.367780:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 164 00000100:00100000:2.0:1788791583.373774:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791583.373919:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606339712 00000100:00100000:1.0:1788791583.373930:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606339712 00000100:00100000:1.0:1788791583.373988:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:1.0:1788791583.373999:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:11483:x1875683606339712:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788791583.374302:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+53:11483:x1875683606339712:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 304us (536us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788791583.374310:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 46 00010000:00010000:1.0:1788791583.396942:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791583.406092:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.406752:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606339968 00000100:00100000:0.0:1788791583.406764:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606339968 00000100:00100000:0.0:1788791583.406831:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 165 00000100:00100000:0.0:1788791583.406842:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+53:11486:x1875683606339968:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791583.406865:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791583.406885:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323811 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675207 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.406963:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323818 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.406978:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323818 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.406989:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323818 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407004:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32381f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407012:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32381f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407019:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32381f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407314:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323826 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407324:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407349:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791583.407359:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788791583.407455:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323818 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407462:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323818 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407469:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323818 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407475:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ffa00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791583.407480:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323818 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407487:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323818 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407500:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:0.0:1788791583.407503:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791583.407507:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323818 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407513:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323818 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407526:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32381f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407531:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32381f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407544:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32381f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407549:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fea00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791583.407552:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32381f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407559:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32381f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407567:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9aba94530b00) 00010000:00010000:0.0:1788791583.407570:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791583.407573:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32381f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407578:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32381f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407620:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323811 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675207 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407633:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675207 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.407641:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:0.0:1788791583.407643:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788791583.407646:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ffc00, rc 0) 00000100:00100000:0.0:1788791583.407775:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:11486:x1875683606339968:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 933us (1688us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788791583.407792:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 165 00000100:00100000:3.0:1788791583.413925:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791583.414017:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791583.414216:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606340224 00000100:00100000:2.0:1788791583.414227:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606340224 00000100:00100000:2.0:1788791583.414300:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:2.0:1788791583.414310:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99365c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:2354:x1875683606340224:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791583.414325:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791583.414349:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323826 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675207 expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.414368:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:2.0:1788791583.414374:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791583.414435:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99365c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:2354:x1875683606340224:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 126us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791583.414444:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:1.0:1788791583.414970:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606340096 00000100:00100000:1.0:1788791583.414976:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606340096 00000100:00100000:1.0:1788791583.415017:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 166 00000100:00100000:1.0:1788791583.415025:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:11486:x1875683606340096:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:1.0:1788791583.415094:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323834 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.415109:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.415120:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.415185:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323834 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.415193:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323834 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.415199:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323834 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.415205:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00e00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791583.415209:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323834 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.415216:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323834 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.415225:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:1.0:1788791583.415228:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788791583.415231:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323834 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.415236:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323834 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791583.415288:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:11486:x1875683606340096:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 264us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791583.415295:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 166 00000100:00100000:3.0:1788791583.419031:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791583.419215:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606340480 00000100:00100000:1.0:1788791583.419225:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606340480 00000100:00100000:1.0:1788791583.419272:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:1.0:1788791583.419283:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:11486:x1875683606340480:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788791583.419499:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:11486:x1875683606340480:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 217us (476us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788791583.419506:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:3.0:1788791583.539281:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.541392:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606340736 00000100:00100000:0.0:1788791583.541407:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606340736 00000100:00100000:0.0:1788791583.541495:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 167 00000100:00100000:0.0:1788791583.541506:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:11504:x1875683606340736:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:0.0:1788791583.541528:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791583.541548:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32383b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367520e expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.541637:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323842 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.541652:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323842 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.541661:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323842 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791583.541671:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788791583.541787:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32383b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367520e expref: 58 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.541922:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323842 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367520e expref: 57 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.541932:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:0.0:1788791583.541935:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788791583.541939:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ffa00, rc 0) 00000100:00100000:0.0:1788791583.542192:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:11504:x1875683606340736:12345-192.168.201.29@tcp:101:cat.0 Request processed in 687us (2921us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788791583.542199:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 167 00000100:00100000:2.0:1788791583.616882:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791583.617050:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606340864 00000100:00100000:1.0:1788791583.617061:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606340864 00000100:00100000:1.0:1788791583.617184:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 168 00000100:00100000:1.0:1788791583.617196:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:11505:x1875683606340864:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788791583.617220:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791583.617241:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323850 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675215 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.617303:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a323857 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.617315:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a323857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.617326:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a323857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791583.617401:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1788791583.617405:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791583.617427:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a323857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.617454:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323850 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675215 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.617472:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a323857 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675215 expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.617480:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:1.0:1788791583.617483:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788791583.617487:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c00a00, rc 0) 00000100:00100000:1.0:1788791583.617549:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+58:11505:x1875683606340864:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 355us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791583.617557:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 168 00000100:00100000:3.0:1788791583.624308:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791583.624579:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606341248 00000100:00100000:1.0:1788791583.624591:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606341248 00000100:00100000:1.0:1788791583.624649:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:1.0:1788791583.624669:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+58:11505:x1875683606341248:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788791583.624990:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb485500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+59:11505:x1875683606341248:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 331us (691us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788791583.624999:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:3.0:1788791583.629797:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791583.645239:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606341376 00000100:00100000:2.0:1788791583.645257:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606341376 00000100:00100000:2.0:1788791583.645345:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:2.0:1788791583.645370:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa001ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+59:11505:x1875683606341376:12345-192.168.201.29@tcp:103:lfs.0 00010000:00010000:2.0:1788791583.645386:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788791583.645411:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a3237e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751f9 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.645435:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323842 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367520e expref: 58 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.645458:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3236f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536751ba expref: 57 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.645570:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530900) 00010000:00010000:2.0:1788791583.645582:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791583.645651:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa001ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+56:11505:x1875683606341376:12345-192.168.201.29@tcp:103:lfs.0 Request processed in 282us (16848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791583.645659:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:2.0:1788791583.652557:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.652708:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606341504 00000100:00100000:0.0:1788791583.652719:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606341504 00000100:00100000:0.0:1788791583.652795:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 169 00000100:00100000:0.0:1788791583.652817:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+56:11505:x1875683606341504:12345-192.168.201.29@tcp:58:lfs.0 00010000:00010000:0.0:1788791583.652938:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32385e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.652955:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32385e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.652967:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32385e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788791583.653205:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788791583.653351:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+56:11505:x1875683606341504:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 545us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791583.653360:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 169 00000100:00100000:1.0:1788791583.714035:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.714164:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606341632 00000100:00100000:0.0:1788791583.714176:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606341632 00000100:00100000:0.0:1788791583.714242:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 170 00000100:00100000:0.0:1788791583.714254:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+56:11507:x1875683606341632:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791583.714273:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791583.714295:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323865 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367521c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714381:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32386c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714400:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32386c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714412:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32386c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714427:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323873 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714433:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714439:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714564:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32387a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714573:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32387a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714580:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32387a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791583.714614:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788791583.714618:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791583.714633:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32387a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714644:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32387a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714664:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32386c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714669:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32386c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714676:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32386c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714681:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791583.714685:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32386c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714692:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32386c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714704:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:0.0:1788791583.714707:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791583.714711:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32386c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714717:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32386c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714731:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714737:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323873 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714743:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323873 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714755:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791583.714757:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323873 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714763:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323873 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714770:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9aba94530e00) 00010000:00010000:0.0:1788791583.714772:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791583.714774:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323873 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714779:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323873 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714810:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323865 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367521c expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714823:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32387a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367521c expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.714831:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530b00) 00010000:00010000:0.0:1788791583.714833:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788791583.714835:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fee00, rc 0) 00000100:00100000:0.0:1788791583.714902:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc115f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:11507:x1875683606341632:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 650us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791583.714909:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 170 00000040:00080000:0.0:1788791583.732592:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788791583.732615:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788791583.732658:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1788791583.732665:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788791583.732820:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875683630456320:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788791583.733029:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbaaa600 going to sleep for 11 seconds 00000100:00100000:0.0:1788791583.748598:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875683630456320:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788791583.757498:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.757591:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606341760 00000100:00100000:0.0:1788791583.757601:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606341760 00000100:00100000:0.0:1788791583.757664:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 171 00000100:00100000:0.0:1788791583.757674:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:11509:x1875683606341760:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788791583.757706:0:5837:0:(mdt_handler.c:8010:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788791583.757827:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:11509:x1875683606341760:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 152us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791583.757835:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 171 00000100:00100000:1.0:1788791583.796621:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.797921:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606341888 00000100:00100000:0.0:1788791583.797934:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606341888 00000100:00100000:0.0:1788791583.798008:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 172 00000100:00100000:0.0:1788791583.798018:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:11509:x1875683606341888:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788791583.798088:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323881 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798103:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323881 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798113:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323881 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798178:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323888 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798197:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323888 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798204:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323888 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798231:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32388f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798238:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32388f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798244:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32388f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791583.798280:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788791583.798284:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791583.798297:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32388f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798307:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323881 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798313:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323881 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798320:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323881 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798325:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791583.798329:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323881 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798343:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323881 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798355:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9aba8823c000) 00010000:00010000:0.0:1788791583.798358:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791583.798363:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323881 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798368:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323881 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798381:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323888 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798386:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323888 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798390:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323888 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798395:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791583.798397:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323888 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798402:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323888 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798408:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9aba94530e00) 00010000:00010000:0.0:1788791583.798411:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791583.798413:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323888 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798427:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a323888 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798440:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32388f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798446:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32388f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798451:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32388f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798456:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791583.798459:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32388f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798466:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32388f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798473:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530b00) 00010000:00010000:0.0:1788791583.798475:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791583.798478:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32388f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.798483:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32388f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791583.798557:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc117b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:11509:x1875683606341888:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 540us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791583.798565:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 172 00000100:00100000:1.0:1788791583.818416:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.818537:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606342144 00000100:00100000:0.0:1788791583.818548:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606342144 00000100:00100000:0.0:1788791583.818616:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 173 00000100:00100000:0.0:1788791583.818627:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:11509:x1875683606342144:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788791583.818647:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791583.818669:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323896 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675223 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.818778:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32389d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.818792:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32389d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.818814:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32389d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791583.818827:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788791583.818922:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32389d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.818931:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32389d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.818938:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32389d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.818944:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791583.818948:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32389d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.818955:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32389d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.818981:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530b00) 00010000:00010000:0.0:1788791583.818984:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788791583.818989:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32389d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.818994:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a32389d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.819033:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323896 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675223 expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.819042:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9aba8823c000) 00010000:00010000:0.0:1788791583.819045:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788791583.819049:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323896 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675223 expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.819057:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff000, rc 0) 00000100:00100000:0.0:1788791583.819120:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc117480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+58:11509:x1875683606342144:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 495us (715us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788791583.819194:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 173 00000100:00100000:1.0:1788791583.837483:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.837635:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606342272 00000100:00100000:0.0:1788791583.837645:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606342272 00000100:00100000:0.0:1788791583.837717:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 174 00000100:00100000:0.0:1788791583.837728:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+58:11509:x1875683606342272:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788791583.837762:0:5839:0:(mdt_handler.c:8010:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788791583.837869:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc116300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+58:11509:x1875683606342272:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 142us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791583.837891:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 174 00000100:00100000:1.0:1788791583.840798:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.840894:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606342528 00000100:00100000:0.0:1788791583.840904:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606342528 00000100:00100000:0.0:1788791583.840968:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 175 00000100:00100000:0.0:1788791583.840978:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+58:11509:x1875683606342528:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788791583.840997:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791583.841000:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788791583.841025:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00a00/0xcd6380150a323857 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675215 expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.841043:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:0.0:1788791583.841047:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788791583.841060:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3238ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367522a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788791583.841728:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788791583.841926:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3238b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.841940:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3238b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.841948:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3238b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.842003:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3238ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367522a expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.842038:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3238b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367522a expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.842046:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9aba94530e00) 00010000:00010000:0.0:1788791583.842049:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788791583.842052:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe600, rc 0) 00000100:00100000:0.0:1788791583.842330:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc116d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+59:11509:x1875683606342528:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1352us (1539us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788791583.842338:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 175 00000100:00100000:1.0:1788791583.862087:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.862241:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606342784 00000100:00100000:0.0:1788791583.862252:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606342784 00000100:00100000:0.0:1788791583.862315:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 176 00000100:00100000:0.0:1788791583.862324:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+59:11509:x1875683606342784:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788791583.862380:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791583.862406:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3238b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367522a expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862426:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9aba94530e00) 00010000:00010000:0.0:1788791583.862435:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788791583.862477:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3238c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862490:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3238c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862499:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3238c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862539:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd1f6c34e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862547:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd1f6c34e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862553:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd1f6c34e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862625:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3238c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862632:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3238c0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862638:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3238c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862644:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791583.862648:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3238c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862655:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3238c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862663:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:0.0:1788791583.862666:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791583.862669:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3238c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862676:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3238c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862692:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd1f6c34e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862698:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd1f6c34e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862704:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd1f6c34e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862709:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791583.862712:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd1f6c34e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862717:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd1f6c34e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862725:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd1f6c34e (ffff9aba94530f00) 00010000:00010000:0.0:1788791583.862727:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791583.862730:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd1f6c34e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.862735:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd1f6c34e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791583.862817:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc114e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+58:11509:x1875683606342784:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 492us (739us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788791583.862824:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 176 00000100:00100000:3.0:1788791583.876627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791583.876759:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606342912 00000100:00100000:2.0:1788791583.876769:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606342912 00000100:00100000:2.0:1788791583.876875:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 177 00000100:00100000:2.0:1788791583.876887:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+58:11509:x1875683606342912:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788791583.876908:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791583.876932:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a800/0xcd6380150a3238ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675231 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.876970:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3238d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.876996:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3238d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.877007:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3238d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.877100:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a800/0xcd6380150a3238ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675231 expref: 60 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.877120:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3238d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675231 expref: 59 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.877194:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9aba8533f400) 00010000:00010000:2.0:1788791583.877197:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788791583.877201:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81bc00, rc 0) 00000100:00100000:2.0:1788791583.877255:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb485880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+59:11509:x1875683606342912:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 371us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791583.877262:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 177 00000100:00100000:1.0:1788791583.880540:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.880681:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606343168 00000100:00100000:0.0:1788791583.880689:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606343168 00000100:00100000:0.0:1788791583.880758:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 178 00000100:00100000:0.0:1788791583.880782:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+59:11509:x1875683606343168:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788791583.880861:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.880877:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.880888:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788791583.881585:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1788791583.881611:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360261483856ns, next at 361261480816ns, rc = 0 00000004:00010000:1.0:1788791583.881718:0:5839:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000090a2a579 reply state 00000000f04611af transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791583.881729:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788791583.881826:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+61:11509:x1875683606343168:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 1045us (1293us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1788791583.881834:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 178 00010000:00010000:2.0:1788791583.884532:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.884550:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.884557:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.884563:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791583.884568:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.884588:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.884605:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9aba8533f400) 00010000:00010000:2.0:1788791583.884608:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788791583.884612:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.884618:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791583.888987:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.889529:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606343296 00000100:00100000:0.0:1788791583.889540:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606343296 00000100:00100000:0.0:1788791583.889607:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 179 00000100:00100000:0.0:1788791583.889618:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+60:11509:x1875683606343296:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788791583.889645:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791583.889666:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3238e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675238 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.889730:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3238e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675238 expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.889744:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3238e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675238 expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.889765:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9aba8533f400) 00010000:00010000:0.0:1788791583.889768:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788791583.889772:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe600, rc 0) 00000100:00100000:0.0:1788791583.889845:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+61:11509:x1875683606343296:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 228us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791583.889868:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 179 00000100:00100000:1.0:1788791583.898480:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791583.898593:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606343424 00000100:00100000:2.0:1788791583.898602:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606343424 00000100:00100000:2.0:1788791583.898679:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:2.0:1788791583.898689:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+6:2355:x1875683606343424:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788791583.899044:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2355:x1875683606343424:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 355us (572us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788791583.899051:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00080000:3.0:1788791583.899364:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788791583.901776:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791583.901973:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606343680 00000100:00100000:1.0:1788791583.901984:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606343680 00000100:00100000:1.0:1788791583.902041:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:1.0:1788791583.902051:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8627b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+61:11509:x1875683606343680:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788791583.902316:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8627b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+62:11509:x1875683606343680:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 265us (547us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788791583.902323:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:0.0:1788791583.910403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791583.924160:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606343936 00000100:00100000:2.0:1788791583.924179:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606343936 00000100:00100000:3.0:1788791583.925211:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 180 00000100:00100000:3.0:1788791583.925223:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+62:11509:x1875683606343936:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788791583.925350:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+62:11509:x1875683606343936:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 129us (14956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791583.925358:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 180 00000100:00100000:2.0:1788791583.930404:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.930490:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606344064 00000100:00100000:0.0:1788791583.930500:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606344064 00000100:00100000:0.0:1788791583.930558:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 181 00000100:00100000:0.0:1788791583.930568:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+62:11509:x1875683606344064:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788791583.930588:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791583.930609:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3238ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367523f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.930683:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.930696:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.930706:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791583.930741:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791583.930759:0:5837:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.930783:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3238ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367523f expref: 64 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.930800:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367523f expref: 63 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.930836:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9aba8533f400) 00010000:00010000:0.0:1788791583.930840:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788791583.930844:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe400, rc 0) 00000100:00100000:0.0:1788791583.930901:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+63:11509:x1875683606344064:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 334us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791583.930908:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 181 00000100:00100000:2.0:1788791583.934290:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.934380:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606344192 00000100:00100000:0.0:1788791583.934390:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606344192 00000100:00100000:0.0:1788791583.934443:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:0.0:1788791583.934460:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2352:x1875683606344192:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788791583.934478:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791583.934497:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ba6a9bb/0xcd6380150a3238f8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675246 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788791583.934524:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ecb1f, blocks: 0x1 00010000:00010000:0.0:1788791583.934541:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=360s v=(0 0) 00010000:00010000:0.0:1788791583.934546:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791583.934555:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ba6a9bb/0xcd6380150a3238f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675246 expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.934574:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ba6a9bb/0xcd6380150a3238f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675246 expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.934588:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff000, rc 0) 00000100:00100000:0.0:1788791583.934662:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc00aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2352:x1875683606344192:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 203us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791583.934669:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:3.0:1788791583.937952:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.938151:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606344448 00000100:00100000:0.0:1788791583.938163:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606344448 00000100:00100000:0.0:1788791583.938226:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 182 00000100:00100000:0.0:1788791583.938237:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+63:11509:x1875683606344448:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788791583.938346:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+63:11509:x1875683606344448:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 110us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791583.938354:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 182 00000100:00100000:2.0:1788791583.955523:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791583.955602:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606344576 00000100:00100000:0.0:1788791583.955612:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606344576 00000100:00100000:0.0:1788791583.955674:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:0.0:1788791583.955684:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:11509:x1875683606344576:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788791583.955703:0:10087:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791583.955722:0:10087:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007405e041/0xcd6380150a3238ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367524d expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.955752:0:10087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ba6a9bb/0xcd6380150a3238f8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675246 expref: 9 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.955761:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791583.955765:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791583.955769:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007405e041/0xcd6380150a3238ff lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367524d expref: 9 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.955834:0:10087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ba6a9bb/0xcd6380150a3238f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675246 expref: 9 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791583.955848:0:10087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ba6a9bb/0xcd6380150a3238f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675246 expref: 9 pid: 6683 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791583.955862:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85781500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10087:1875683630456448:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791583.955945:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbaaa000 going to sleep for 11 seconds 00000100:00100000:1.0:1788791583.961354:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85781500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10087:1875683630456448:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791583.961390:0:10087:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007405e041/0xcd6380150a3238ff lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a945367524d expref: 9 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791583.961433:0:10087:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff600, rc 0) 00000100:00100000:1.0:1788791583.961503:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc135880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:11509:x1875683606344576:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 5818us (5987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791583.961513:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:3.0:1788791583.962455:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791583.962569:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606344704 00000100:00100000:2.0:1788791583.962582:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606344704 00010000:00010000:2.0:1788791583.962650:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ba6a9bb/0xcd6380150a3238f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675246 expref: 9 pid: 6683 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791583.962724:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:2.0:1788791583.962737:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8627b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2354:x1875683606344704:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791583.962760:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791583.962795:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ba6a9bb/0xcd6380150a3238f8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675246 expref: 9 pid: 6683 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.962813:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ba6a9bb/0xcd6380150a3238f8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675246 expref: 9 pid: 6683 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.962846:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ba6a9bb/0xcd6380150a3238f8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675246 expref: 9 pid: 6683 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.962869:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791583.962875:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791583.962885:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007405e041/0xcd6380150a3238ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0xcf751a945367524d expref: 8 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.962897:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007405e041/0xcd6380150a3238ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0xcf751a945367524d expref: 8 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791583.962946:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007405e041/0xcd6380150a3238ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a945367524d expref: 8 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791583.962965:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc135180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1875683630456576:192.168.201.29@tcp:105: 00000100:00100000:2.0:1788791583.963078:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba84d0f9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791583.977515:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc135180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1875683630456576:192.168.201.29@tcp:105: 00010000:00010000:3.0:1788791583.977545:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791583.977607:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8627b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2354:x1875683606344704:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 14873us (15175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791583.977618:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:1.0:1788791583.987622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791583.987716:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606344832 00000100:00100000:2.0:1788791583.987728:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606344832 00002000:00100000:2.0:1788791583.987784:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9abab299ca80 x1875683606344832/t0(0) o4->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:294/0 lens 504/0 e 0 to 0 dl 1788791594 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788791583.987795:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9abab299ca80 with x1875683606344832 ext(0->8) 00002000:00010000:2.0:1788791583.987801:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9abab299ca80 00000100:00100000:2.0:1788791583.987890:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:2.0:1788791583.987901:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2354:x1875683606344832:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788791583.988385:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:2354:x1875683606344832:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 Request processed in 485us (772us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788791583.988394:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00002000:00100000:2.0:1788791583.988401:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9abab299ca80 x1875683606344832/t4294967314(0) o4->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:294/0 lens 504/448 e 0 to 0 dl 1788791594 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788791583.988408:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9abab299ca80 with x1875683606344832 ext(0->8) 00002000:00010000:2.0:1788791583.988412:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9abab299ca80 00000100:00100000:1.0:1788791584.002837:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791584.002975:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606344960 00000100:00100000:2.0:1788791584.002986:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606344960 00000100:00100000:2.0:1788791584.003039:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 183 00000100:00100000:2.0:1788791584.003050:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+63:11509:x1875683606344960:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788791584.106956:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:0.0:1788791584.106969:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:1.0:1788791584.107264:0:12166:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000100:00100000:2.0:1788791584.107698:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+45:11509:x1875683606344960:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 104644us (104863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791584.107708:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 183 00000100:00100000:2.0:1788791584.107744:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba8627b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630456704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788791584.107806:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791584.109459:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630456704 00000100:00100000:2.0:1788791584.109472:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630456704 00000100:00100000:2.0:1788791584.109534:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788791584.109546:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630456704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788791584.109740:0:12011:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788791584.109744:0:12011:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788791583 00002000:00010000:2.0:1788791584.109747:0:12011:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788791584.109749:0:12011:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788791583 -> 1788791583 00002000:00010000:2.0:1788791584.109752:0:12011:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788791584.109987:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3315:x1875683630456704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 442us (2179us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788791584.109995:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788791584.110022:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788791584.110062:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9aba8627b100/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788791584.110068:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba8627b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630456704:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1788791584.110579:0:12166:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:0.0:1788791584.111081:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630456832:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788791584.111164:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788791584.111299:0:12166:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9abab78da000 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788791584.111304:0:12166:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ababb05bd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9abab78dac00 00000020:00080000:1.0:1788791584.111307:0:12166:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9ababb05b800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9aba8325ac00 00000020:00080000:1.0:1788791584.111385:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1788791584.111548:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788791584.111824:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630456832 00000100:00100000:3.0:1788791584.111832:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630456832 00000100:00100000:3.0:1788791584.112646:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788791584.112659:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875683630456832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788791584.112689:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1788791584.113120:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ecb1d, atime: 0x6a9ecb1d, ctime: 0x6a9ecb1d, blocks: 0x1 00010000:00010000:3.0:1788791584.113157:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a323906 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788791584.113171:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788791584.113176:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1788791584.113182:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791584.113189:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a323906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.113206:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a323906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.113217:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a323906 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.113226:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a323906 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.113255:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791584.113959:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791584.113967:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a323906 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791584.113978:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791584.113983:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a323906 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791584.113992:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a323906 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791584.114009:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a323906 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791584.114023:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ca2a1b4/0xcd6380150a323906 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791584.114042:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791584.114044:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791584.114046:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791584.117293:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791584.117519:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606345088 00000100:00100000:0.0:1788791584.117530:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606345088 00000100:00100000:0.0:1788791584.117591:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:0.0:1788791584.117602:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:2355:x1875683606345088:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788791584.117641:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1875683630456832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4984us (6474us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788791584.117650:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:3.0:1788791584.117705:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ababc135f80/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788791584.117712:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630456832:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788791584.149118:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:2355:x1875683606345088:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 31508us (31829us total) trans 0 rc 0/0 00000001:00080000:3.0:1788791584.149172:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1788791584.149186:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1788791584.149203:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:3.0:1788791584.158459:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791584.162483:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606345344 00000100:00100000:0.0:1788791584.162500:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606345344 00000100:00100000:0.0:1788791584.162583:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 184 00000100:00100000:0.0:1788791584.162594:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:11509:x1875683606345344:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788791584.162651:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791584.162677:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3238f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367523f expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791584.162697:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9aba8533f400) 00010000:00010000:0.0:1788791584.162702:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788791584.162733:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a32390d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791584.162773:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a32390d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791584.162782:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a32390d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788791584.163015:0:5836:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000041e4bfb3 reply state 000000002e29d791 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a32390d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791584.163024:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788791584.163200:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+19:11509:x1875683606345344:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 606us (4748us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788791584.163208:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 184 00010000:00010000:3.0:1788791584.172773:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a32390d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.172791:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a32390d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.172799:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a32390d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.172805:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fec00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791584.172811:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a32390d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.172819:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a32390d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.172835:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9aba8533f400) 00010000:00010000:3.0:1788791584.172839:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791584.172843:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a32390d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.172849:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a32390d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791584.175523:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791584.175658:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606345472 00000100:00100000:2.0:1788791584.175668:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606345472 00000100:00100000:2.0:1788791584.175788:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:2.0:1788791584.175799:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8625a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2352:x1875683606345472:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788791584.176050:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788791584.176054:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788791583 -> 1788791583 00002000:00010000:2.0:1788791584.176056:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788791581 00002000:00010000:2.0:1788791584.176058:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788791583 -> 1788791583 00002000:00010000:2.0:1788791584.176060:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788791584.176161:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8625a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2352:x1875683606345472:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 330us (615us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788791584.176182:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:1.0:1788791584.178999:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791584.179088:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606345728 00000100:00100000:3.0:1788791584.179098:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606345728 00000100:00100000:3.0:1788791584.179197:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 185 00000100:00100000:3.0:1788791584.179207:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:11509:x1875683606345728:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788791584.179280:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323914 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.179296:0:8351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3238d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675231 expref: 18 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.179306:0:8351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323914 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.179340:0:8351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3238d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675231 expref: 18 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.179352:0:8351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3238d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675231 expref: 18 pid: 8351 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791584.179366:0:8351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8351:1875683630456960:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788791584.179458:0:8351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788791584.182261:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791584.182347:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606345856 00000100:00100000:0.0:1788791584.182357:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606345856 00010000:00010000:0.0:1788791584.182402:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3238d5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675231 expref: 19 pid: 8351 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791584.182523:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:0.0:1788791584.182534:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+19:2354:x1875683606345856:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788791584.182549:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791584.182556:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3238d5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675231 expref: 19 pid: 8351 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791584.182569:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3238d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675231 expref: 19 pid: 8351 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791584.182591:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9aba8533f400) 00010000:00010000:0.0:1788791584.182609:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323914 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791584.182619:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791584.182627:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323914 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791584.182646:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788791584.182877:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3238d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675231 expref: 19 pid: 8351 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791584.182897:0:8351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8351:1875683630456960:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791584.182922:0:8351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.182931:0:8351:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.182938:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.183233:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.183242:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323914 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.183248:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323914 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.183255:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16de00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791584.183259:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323914 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.183267:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323914 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.183277:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9aba8533f400) 00010000:00010000:3.0:1788791584.183280:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788791584.183284:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323914 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.183291:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323914 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791584.183333:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:11509:x1875683606345728:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 Request processed in 4127us (4345us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788791584.183342:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 185 00000100:00100000:0.0:1788791584.183425:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc135c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+17:2354:x1875683606345856:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 171us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791584.183433:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:1.0:1788791584.186007:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791584.186081:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606345984 00000100:00100000:3.0:1788791584.186091:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606345984 00000100:00100000:3.0:1788791584.186174:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:3.0:1788791584.186197:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2355:x1875683606345984:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788791584.186243:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000b35bafd/0xcd6380150a32391b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.186263:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007405e041/0xcd6380150a3238ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a945367524d expref: 8 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.186272:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791584.186277:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788791584.186282:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b35bafd/0xcd6380150a32391b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.186317:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007405e041/0xcd6380150a3238ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367524d expref: 8 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.186331:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007405e041/0xcd6380150a3238ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367524d expref: 8 pid: 10087 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791584.186346:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1875683630457088:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788791584.186426:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788791584.190452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791584.190894:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606346112 00000100:00100000:0.0:1788791584.190905:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606346112 00010000:00010000:0.0:1788791584.190946:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007405e041/0xcd6380150a3238ff lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367524d expref: 9 pid: 10087 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791584.191035:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:0.0:1788791584.191047:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc136d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2354:x1875683606346112:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788791584.191062:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791584.191087:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007405e041/0xcd6380150a3238ff lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367524d expref: 9 pid: 10087 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791584.191102:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007405e041/0xcd6380150a3238ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367524d expref: 9 pid: 10087 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791584.191156:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788791584.191162:0:8452:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788791584.191181:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000b35bafd/0xcd6380150a32391b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791584.191192:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b35bafd/0xcd6380150a32391b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791584.191213:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791584.191275:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc136d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2354:x1875683606346112:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 231us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791584.191283:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 71 00010000:00010000:3.0:1788791584.191413:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007405e041/0xcd6380150a3238ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0xcf751a945367524d expref: 8 pid: 10087 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791584.191428:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1875683630457088:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791584.191460:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000b35bafd/0xcd6380150a32391b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.191478:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000b35bafd/0xcd6380150a32391b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.191486:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b35bafd/0xcd6380150a32391b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.191522:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000b35bafd/0xcd6380150a32391b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.191531:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b35bafd/0xcd6380150a32391b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.191538:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b35bafd/0xcd6380150a32391b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.191544:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16ce00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791584.191549:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b35bafd/0xcd6380150a32391b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.191558:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b35bafd/0xcd6380150a32391b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.191571:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b35bafd/0xcd6380150a32391b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.191590:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b35bafd/0xcd6380150a32391b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791584.191638:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2355:x1875683606345984:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 5443us (5638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791584.191646:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:1.0:1788791584.194186:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791584.194333:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606346368 00000100:00100000:3.0:1788791584.194342:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606346368 00000100:00100000:3.0:1788791584.194393:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 186 00000100:00100000:3.0:1788791584.194403:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+17:11509:x1875683606346368:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788791584.194489:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323922 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.194518:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323922 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.194529:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323922 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.194744:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323929 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.194755:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3238e3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675238 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.194762:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323929 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.194810:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3238e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675238 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.194823:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3238e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675238 expref: 18 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791584.194837:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630457216:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788791584.194924:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788791584.197024:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630457216:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791584.197056:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323929 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791584.198582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791584.198881:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606346496 00000100:00100000:3.0:1788791584.198891:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606346496 00010000:00010000:3.0:1788791584.198930:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3238e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675238 expref: 19 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791584.198975:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:3.0:1788791584.198985:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb702300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+19:2355:x1875683606346496:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791584.198999:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791584.199007:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3238e3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675238 expref: 19 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.199019:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3238e3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675238 expref: 19 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.199058:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe600/0xcd6380150a3238e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675238 expref: 19 pid: 5837 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.199074:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9aba8533f400) 00010000:00010000:3.0:1788791584.199079:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323929 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.199087:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323929 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.199094:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323929 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.199168:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791584.199220:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb702300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:2355:x1875683606346496:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 236us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791584.199228:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 72 00010000:00010000:1.0:1788791584.199297:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323929 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791584.199306:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323929 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788791584.199499:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788791584.199648:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788791584.199832:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788791584.199922:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb703100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1875683630457344:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788791584.199974:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791584.200014:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab2d7dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791584.201181:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630457344 00000100:00100000:3.0:1788791584.201192:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630457344 00000100:00100000:3.0:1788791584.201253:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788791584.201263:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875683630457344:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788791584.201355:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb701180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875683630457344:12345-0@lo:1000:mdt00_000.0 Request processed in 94us (1380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791584.201362:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788791584.201779:0:5836:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1788791584.201787:0:5836:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9aba8627b100, transno 4294967315 00000100:00100000:1.0:1788791584.201807:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb703100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1875683630457344:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788791584.202313:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788791584.202387:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb703100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1875683630457472:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788791584.202431:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791584.202473:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab2d7d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788791584.202946:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630457472 00000100:00100000:0.0:1788791584.202953:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630457472 00000100:00100000:0.0:1788791584.203002:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788791584.203012:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5836:x1875683630457472:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788791584.203235:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1875683630457472:12345-0@lo:1000:mdt00_000.0 Request processed in 224us (803us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788791584.203243:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788791584.203417:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb703100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5836:1875683630457472:0@lo:1000:mdt00_000.0 00010000:00010000:3.0:1788791584.203462:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323929 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203484:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323929 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203492:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323929 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203498:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791584.203503:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323929 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203511:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323929 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203526:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9aba8533f400) 00010000:00010000:3.0:1788791584.203529:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788791584.203533:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323929 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203539:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323929 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203567:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32385e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203573:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32385e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203578:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32385e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203583:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fea00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791584.203592:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32385e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203598:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32385e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203606:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530b00) 00010000:00010000:3.0:1788791584.203608:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788791584.203611:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32385e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203617:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a32385e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203635:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323930 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203648:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32387a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367521c expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203657:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323930 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203684:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32387a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367521c expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.203697:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32387a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367521c expref: 21 pid: 5839 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791584.203722:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630457600:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788791584.203784:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788791584.214107:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab3081500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630457600:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791584.222067:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323930 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791584.222841:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791584.223214:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606346624 00000100:00100000:2.0:1788791584.223224:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606346624 00010000:00010000:2.0:1788791584.223263:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32387a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367521c expref: 22 pid: 5839 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791584.223311:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 73 00000100:00100000:2.0:1788791584.223321:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+22:2355:x1875683606346624:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791584.223334:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791584.223341:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32387a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367521c expref: 22 pid: 5839 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.223354:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32387a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367521c expref: 22 pid: 5839 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.223376:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a32387a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367521c expref: 22 pid: 5839 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.223391:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530b00) 00010000:00010000:2.0:1788791584.223396:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323930 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.223412:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323930 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.223420:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323930 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.223446:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791584.223507:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+21:2355:x1875683606346624:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 187us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791584.223515:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 73 00010000:00010000:3.0:1788791584.224071:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323930 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.224081:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323930 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.224092:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323930 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.224099:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323930 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.224105:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323930 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.224111:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16de00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791584.224115:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323930 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.224122:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323930 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.224163:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530b00) 00010000:00010000:3.0:1788791584.224166:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791584.224170:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323930 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.224176:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323930 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.224187:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323922 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.224192:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323922 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.224205:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323922 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.224210:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791584.224213:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323922 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.224219:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323922 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.224227:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba94530b00) 00010000:00010000:3.0:1788791584.224271:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788791584.224274:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323922 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791584.224280:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323922 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791584.224520:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+20:11509:x1875683606346368:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 30117us (30342us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788791584.224529:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 186 00000020:00080000:3.0:1788791584.224533:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788791584.225295:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788791584.225301:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788791584.225827:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788791584.225836:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788791584.234953:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791584.235043:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606346880 00000100:00100000:1.0:1788791584.235054:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606346880 00000100:00100000:1.0:1788791584.235118:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:1.0:1788791584.235158:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99282050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+20:11509:x1875683606346880:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788791584.236371:0:5840:0:(mdd_object.c:4131:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788791584.237925:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1788791584.237995:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323937 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791584.238012:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323937 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791584.238023:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323937 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791584.238032:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323937 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791584.238052:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323937 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791584.238059:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323937 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791584.238086:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788791584.238230:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99282050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+22:11509:x1875683606346880:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 3098us (3284us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788791584.238239:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00000020:00080000:1.0:1788791584.238245:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788791584.239993:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791584.240005:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323937 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.240015:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791584.240020:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323937 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.240030:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323937 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.240044:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9ababb052800) 00010000:00010000:2.0:1788791584.240047:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788791584.240052:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323937 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.240072:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323937 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.240092:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791584.240094:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791584.240095:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791584.303361:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791584.303404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791584.303448:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791584.303613:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606347136 00000100:00100000:0.0:1788791584.303624:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606347136 00000100:00100000:0.0:1788791584.303704:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:0.0:1788791584.303715:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2353:x1875683606347136:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791584.303785:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3081500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2353:x1875683606347136:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 71us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791584.303792:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:1.0:1788791584.304023:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606347264 00000100:00100000:1.0:1788791584.304028:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606347264 00000100:00100000:1.0:1788791584.304064:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 149 00000100:00100000:1.0:1788791584.304071:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8627b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28665881-f918-4421-b36a-72ee58aec27e+5:2353:x1875683606347264:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791584.304104:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8627b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28665881-f918-4421-b36a-72ee58aec27e+5:2353:x1875683606347264:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 33us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791584.304111:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 149 00000100:00080000:3.0:1788791584.305270:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788791584.305282:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791584.308160:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606347008 00000100:00100000:2.0:1788791584.308175:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606347008 00000100:00100000:2.0:1788791584.308298:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 296 00000100:00100000:2.0:1788791584.308310:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2353:x1875683606347008:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791584.308436:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2353:x1875683606347008:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 128us (5030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791584.308445:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 296 00010000:00010000:3.0:1788791584.423724:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788791584.809010:0:12454:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788791584.809019:0:12454:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788791584.809267:0:12454:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788791584.809277:0:12454:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788791584.952537:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791584.956061:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606347520 00000100:00100000:2.0:1788791584.956075:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606347520 00000100:00100000:2.0:1788791584.956164:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 187 00000100:00100000:2.0:1788791584.956176:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+22:11528:x1875683606347520:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791584.956201:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791584.956222:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a32393e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675254 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.956457:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323945 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.956471:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323945 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.956483:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323945 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791584.956499:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1788791584.956666:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a32393e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675254 expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.956683:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323945 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675254 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.956692:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:2.0:1788791584.956695:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788791584.956699:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81b000, rc 0) 00000100:00100000:2.0:1788791584.956764:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+24:11528:x1875683606347520:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 590us (4235us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788791584.956771:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 187 00000100:00100000:1.0:1788791584.973446:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791584.979976:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606347648 00000100:00100000:2.0:1788791584.979990:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606347648 00000100:00100000:2.0:1788791584.980057:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 188 00000100:00100000:2.0:1788791584.980068:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+24:11528:x1875683606347648:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:2.0:1788791584.980169:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323953 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980187:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323953 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980198:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323953 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980213:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32395a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980234:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32395a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980241:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32395a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980520:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a323961 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980528:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a323961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980535:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a323961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788791584.980568:0:5837:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a323961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980578:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323953 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980584:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323953 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980590:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323953 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980596:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81ae00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791584.980599:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323953 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980606:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323953 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980621:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:2.0:1788791584.980624:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791584.980628:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323953 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980633:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323953 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980641:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32395a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980646:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32395a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980651:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32395a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980656:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81ac00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791584.980658:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32395a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980664:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32395a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980670:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9aba8533f200) 00010000:00010000:2.0:1788791584.980672:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791584.980674:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32395a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980679:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32395a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980700:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a323961 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980705:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a323961 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980710:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a323961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980714:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791584.980716:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a323961 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980721:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a323961 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980727:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791584.980729:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791584.980731:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a323961 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791584.980736:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b200/0xcd6380150a323961 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791584.980815:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb703b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+24:11528:x1875683606347648:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 749us (7377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791584.980822:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 188 00000100:00100000:2.0:1788791585.038376:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791585.038462:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606347904 00000100:00100000:1.0:1788791585.038473:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606347904 00000100:00100000:1.0:1788791585.038560:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 189 00000100:00100000:1.0:1788791585.038572:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+24:11531:x1875683606347904:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788791585.038593:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791585.038613:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323968 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367525b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.038718:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32396f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.038734:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32396f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.038746:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32396f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.038759:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323976 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.038767:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.038774:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039077:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32397d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039086:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32397d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039094:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32397d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791585.039103:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788791585.039248:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32396f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039256:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32396f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039269:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32396f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039276:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791585.039280:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32396f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039287:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32396f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039300:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:1.0:1788791585.039303:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791585.039308:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32396f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039313:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a32396f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039326:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039332:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323976 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039337:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039342:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01e00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791585.039345:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039374:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323976 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039382:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9ababb052d00) 00010000:00010000:1.0:1788791585.039384:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791585.039387:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323976 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039393:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01e00/0xcd6380150a323976 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039430:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01600/0xcd6380150a323968 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367525b expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039443:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32397d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367525b expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.039449:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ababb052f00) 00010000:00010000:1.0:1788791585.039451:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788791585.039454:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c01200, rc 0) 00000100:00100000:1.0:1788791585.039517:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+26:11531:x1875683606347904:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 947us (1150us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788791585.039526:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 189 00000100:00080000:3.0:1788791585.039721:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791585.043275:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791585.043360:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606348032 00000100:00100000:2.0:1788791585.043369:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606348032 00000100:00100000:2.0:1788791585.043441:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 190 00000100:00100000:2.0:1788791585.043450:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+26:11531:x1875683606348032:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:2.0:1788791585.043520:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32398b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.043535:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32398b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.043545:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32398b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.043575:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32398b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.043583:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32398b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.043589:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32398b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.043596:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81ac00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791585.043600:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32398b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.043606:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32398b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.043617:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ababb052f00) 00010000:00010000:2.0:1788791585.043620:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788791585.043624:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32398b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.043640:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32398b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791585.043704:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+26:11531:x1875683606348032:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 255us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791585.043720:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 190 00000100:00100000:2.0:1788791585.048444:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791585.048499:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606348288 00000100:00100000:0.0:1788791585.048508:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606348288 00000100:00100000:0.0:1788791585.048563:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:0.0:1788791585.048573:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+26:11531:x1875683606348288:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1788791585.048773:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+27:11531:x1875683606348288:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 201us (350us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1788791585.048780:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:1.0:1788791585.072061:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791585.072161:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606348544 00000100:00100000:2.0:1788791585.072171:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606348544 00000100:00100000:2.0:1788791585.072268:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 191 00000100:00100000:2.0:1788791585.072279:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+27:11066:x1875683606348544:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788791585.072304:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791585.072326:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a323992 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675262 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.072434:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323999 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.072449:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32397d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367525b expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.072458:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323999 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.072491:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32397d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367525b expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.072652:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32397d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367525b expref: 28 pid: 5839 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791585.072684:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb911c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630457728:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788791585.072784:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba84d0f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791585.075018:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb911c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630457728:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791585.075045:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323999 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791585.086349:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791585.086528:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606348672 00000100:00100000:3.0:1788791585.086538:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606348672 00010000:00010000:3.0:1788791585.086592:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32397d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367525b expref: 29 pid: 5839 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791585.086638:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 74 00000100:00100000:3.0:1788791585.086649:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+29:2355:x1875683606348672:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791585.086663:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791585.086671:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32397d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367525b expref: 29 pid: 5839 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.086685:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32397d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367525b expref: 29 pid: 5839 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.086717:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a32397d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367525b expref: 29 pid: 5839 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.086734:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ababb052f00) 00010000:00010000:3.0:1788791585.086740:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323999 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.086750:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323999 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.086758:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323999 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.087252:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791585.087326:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e09c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+28:2355:x1875683606348672:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 677us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791585.087335:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 74 00010000:00010000:2.0:1788791585.087788:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323999 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.087800:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323999 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791585.087821:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788791585.087970:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a323992 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675262 expref: 29 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.087988:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323999 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675262 expref: 28 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.087996:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ababb052f00) 00010000:00010000:2.0:1788791585.087998:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788791585.088001:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81ae00, rc 0) 00000100:00100000:2.0:1788791585.088753:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+28:11066:x1875683606348544:12345-192.168.201.29@tcp:101:bash.0 Request processed in 16472us (16699us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788791585.088762:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 191 00000100:00100000:1.0:1788791585.092929:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791585.093007:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606348928 00000100:00100000:2.0:1788791585.093041:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606348928 00000100:00100000:2.0:1788791585.093101:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 192 00000100:00100000:2.0:1788791585.093121:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+28:11066:x1875683606348928:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:2.0:1788791585.093412:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a3239a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.093603:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a3239a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.093617:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a3239a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788791585.093670:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788791585.093695:0:5837:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 0000000074bd91a5 reply state 000000008055a8c4 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a3239a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791585.093705:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788791585.093752:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788791585.093852:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+32:11066:x1875683606348928:12345-192.168.201.29@tcp:36:bash.0 Request processed in 741us (932us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788791585.093860:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 192 00000020:00080000:2.0:1788791585.093865:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788791585.096171:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a3239a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.096187:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a3239a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.096195:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a3239a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.096201:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81be00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791585.096221:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a3239a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.096228:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a3239a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.096244:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ababb052f00) 00010000:00010000:2.0:1788791585.096247:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791585.096251:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a3239a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.096257:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a3239a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791585.096597:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791585.096674:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606349056 00000100:00100000:2.0:1788791585.096683:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606349056 00000100:00100000:2.0:1788791585.096735:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 193 00000100:00100000:2.0:1788791585.096745:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+31:11066:x1875683606349056:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788791585.096768:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791585.096783:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3239ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675269 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.096834:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3239ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675269 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.096846:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3239ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675269 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.096863:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ababb052f00) 00010000:00010000:2.0:1788791585.096866:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788791585.096877:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81aa00, rc 0) 00000100:00100000:2.0:1788791585.096931:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+32:11066:x1875683606349056:12345-192.168.201.29@tcp:101:bash.0 Request processed in 186us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791585.096937:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 193 00000100:00100000:3.0:1788791585.100476:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791585.100568:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606349184 00000100:00100000:2.0:1788791585.100578:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606349184 00000100:00100000:2.0:1788791585.100651:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:2.0:1788791585.100660:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8627b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:11066:x1875683606349184:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788791585.100680:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791585.100702:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a3239b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675270 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788791585.100729:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ecb1f, atime: 0x6a9ecb1d, ctime: 0x6a9ecb1f, blocks: 0xb 00010000:00010000:2.0:1788791585.100752:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1788791585.100757:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791585.100765:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a3239b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675270 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.100784:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a3239b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675270 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.100797:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81ac00, rc 0) 00000100:00100000:2.0:1788791585.100868:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8627b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:11066:x1875683606349184:12345-192.168.201.29@tcp:101:bash.0 Request processed in 208us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791585.100875:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00080000:3.0:1788791585.101059:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788791585.103407:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791585.103561:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606349312 00000100:00100000:3.0:1788791585.103572:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606349312 00002000:00010000:3.0:1788791585.103611:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788791585.103615:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ababb485500 with x1875683606349312 ext(0->18446744073709551615) 00002000:00010000:3.0:1788791585.103625:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ababb485500. 00000100:00100000:3.0:1788791585.103660:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788791585.103669:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2354:x1875683606349312:12345-192.168.201.29@tcp:10:bash.0 00002000:00010000:3.0:1788791585.103925:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788791585.103928:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788791583 -> 1788791585 00002000:00010000:3.0:1788791585.103931:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788791581 -> 1788791581 00002000:00010000:3.0:1788791585.103933:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788791583 -> 1788791585 00002000:00010000:3.0:1788791585.103934:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788791585.104000:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb485500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2354:x1875683606349312:12345-192.168.201.29@tcp:10:bash.0 Request processed in 331us (601us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788791585.104007:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00002000:00010000:3.0:1788791585.104010:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788791585.104013:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ababb485500 with x1875683606349312 ext(0->18446744073709551615) 00002000:00010000:3.0:1788791585.104017:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ababb485500. 00000100:00100000:0.0:1788791585.200414:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791585.200556:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606349440 00000100:00100000:3.0:1788791585.200577:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606349440 00000100:00100000:3.0:1788791585.200632:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 194 00000100:00100000:3.0:1788791585.200642:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+32:11545:x1875683606349440:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:3.0:1788791585.200722:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3239bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.200739:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3239bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.200750:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3239bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.200764:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3239c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.200770:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3239c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.200776:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3239c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201056:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201065:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201073:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788791585.201122:0:8351:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201189:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3239bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201196:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3239bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201204:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3239bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201209:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791585.201213:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3239bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201221:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3239bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201233:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:3.0:1788791585.201236:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791585.201241:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3239bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201247:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a3239bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201258:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3239c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201264:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3239c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201269:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3239c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201280:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16de00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791585.201283:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3239c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201290:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3239c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201298:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9aba8823ce00) 00010000:00010000:3.0:1788791585.201300:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791585.201303:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3239c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201309:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3239c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201324:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201330:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201336:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201341:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16da00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791585.201343:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201349:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201366:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ababb052f00) 00010000:00010000:3.0:1788791585.201368:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791585.201371:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.201377:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791585.201470:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+32:11545:x1875683606349440:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 828us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791585.201479:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 194 00000100:00100000:1.0:1788791585.235443:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791585.235723:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606349696 00000100:00100000:2.0:1788791585.235746:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606349696 00000100:00100000:2.0:1788791585.235809:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 195 00000100:00100000:2.0:1788791585.235820:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+32:11548:x1875683606349696:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791585.235840:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791585.235861:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a3239d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675277 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.235932:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a3239d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.235945:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a3239d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.235955:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a3239d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.235967:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3239df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.235974:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3239df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.235980:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3239df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236320:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3239e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236328:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3239e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236335:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3239e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791585.236351:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788791585.236453:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a3239d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236461:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a3239d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236467:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a3239d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236473:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81a600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791585.236477:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a3239d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236484:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a3239d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236496:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:2.0:1788791585.236499:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791585.236795:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a3239d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236803:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a3239d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236816:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3239df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236822:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3239df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236838:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3239df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236843:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81bc00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791585.236846:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3239df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236852:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3239df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236860:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9aba8533f300) 00010000:00010000:2.0:1788791585.236863:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791585.236866:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3239df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236872:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a3239df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236907:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a3239d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675277 expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236919:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3239e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675277 expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.236926:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ababb052f00) 00010000:00010000:2.0:1788791585.236928:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788791585.236930:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81ba00, rc 0) 00000100:00100000:2.0:1788791585.237024:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+34:11548:x1875683606349696:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1206us (1602us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788791585.237041:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 195 00000100:00100000:1.0:1788791585.240763:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791585.240938:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606349824 00000100:00100000:3.0:1788791585.240948:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606349824 00000100:00100000:3.0:1788791585.241005:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 196 00000100:00100000:3.0:1788791585.241015:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+34:11548:x1875683606349824:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:3.0:1788791585.241079:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.241094:0:8351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323999 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675262 expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.241102:0:8351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239f4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.241181:0:8351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323999 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675262 expref: 34 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.241194:0:8351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323999 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675262 expref: 34 pid: 5836 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791585.241221:0:8351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb710700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8351:1875683630457856:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788791585.241308:0:8351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababb80f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788791585.244283:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791585.244381:0:8351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb710700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8351:1875683630457856:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791585.244406:0:8351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791585.244670:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606350080 00000100:00100000:1.0:1788791585.244678:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606350080 00000100:00100000:1.0:1788791585.244744:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:1.0:1788791585.244754:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+35:5595:x1875683606350080:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788791585.245096:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+36:5595:x1875683606350080:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 342us (820us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788791585.245104:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:3.0:1788791585.247401:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791585.247480:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606350208 00000100:00100000:2.0:1788791585.247489:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606350208 00010000:00010000:2.0:1788791585.247535:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323999 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675262 expref: 36 pid: 5836 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791585.247575:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:2.0:1788791585.247584:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa001cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+36:2354:x1875683606350208:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791585.247598:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791585.247605:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323999 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675262 expref: 36 pid: 5836 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.247617:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323999 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675262 expref: 36 pid: 5836 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.247640:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323999 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675262 expref: 36 pid: 5836 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.247656:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ababb052f00) 00010000:00010000:2.0:1788791585.247662:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.247672:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.247679:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239f4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.247734:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791585.248164:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa001cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+35:2354:x1875683606350208:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 579us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791585.248173:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 75 00010000:00010000:2.0:1788791585.248241:0:8351:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.248250:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.248279:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.248287:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.248294:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.248300:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16da00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791585.248303:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.248310:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.248319:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ababb052f00) 00010000:00010000:2.0:1788791585.248322:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788791585.248326:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.248343:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16da00/0xcd6380150a3239f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791585.249626:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+34:11548:x1875683606349824:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 8606us (8865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791585.249637:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 196 00000100:00100000:2.0:1788791585.251964:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791585.252030:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606350464 00000100:00100000:0.0:1788791585.252040:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606350464 00000100:00100000:0.0:1788791585.252095:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:0.0:1788791585.252106:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+34:11548:x1875683606350464:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:0.0:1788791585.252592:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+35:11548:x1875683606350464:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 486us (634us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788791585.252600:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:2.0:1788791585.354866:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791585.355013:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606350720 00000100:00100000:3.0:1788791585.355023:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606350720 00000100:00100000:3.0:1788791585.355078:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 197 00000100:00100000:3.0:1788791585.355090:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+35:11559:x1875683606350720:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:3.0:1788791585.355180:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791585.355202:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3239fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367527e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.355272:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323a02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.355286:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323a02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.355297:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323a02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.355311:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323a09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.355318:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323a09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.355336:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323a09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.355672:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323a10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.355932:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.355942:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791585.355952:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788791585.356045:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323a02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.356053:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323a02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.356060:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323a02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.356066:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791585.356069:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323a02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.356077:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323a02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.356089:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:3.0:1788791585.356092:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791585.356103:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323a02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.356121:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323a02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.356162:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323a09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.356168:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323a09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.356174:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323a09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.356179:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791585.356182:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323a09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.356188:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323a09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.356196:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9aba8823ce00) 00010000:00010000:3.0:1788791585.356199:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791585.356202:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323a09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.356208:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323a09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.356250:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a3239fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367527e expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.356277:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367527e expref: 37 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.356285:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ababb052f00) 00010000:00010000:3.0:1788791585.356287:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788791585.356290:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16ce00, rc 0) 00000100:00100000:3.0:1788791585.356351:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+37:11559:x1875683606350720:12345-192.168.201.29@tcp:101:cat.0 Request processed in 1262us (1494us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788791585.356359:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 197 00000100:00100000:1.0:1788791585.361175:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791585.361304:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606350976 00000100:00100000:3.0:1788791585.361314:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606350976 00000100:00100000:3.0:1788791585.361368:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:3.0:1788791585.361378:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+37:11559:x1875683606350976:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:3.0:1788791585.361602:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+38:11559:x1875683606350976:12345-192.168.201.29@tcp:35:cat.0 Request processed in 224us (473us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788791585.361609:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 54 00000100:00100000:0.0:1788791585.405864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791585.405965:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606351232 00000100:00100000:2.0:1788791585.405975:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606351232 00000100:00100000:2.0:1788791585.406039:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 198 00000100:00100000:2.0:1788791585.406049:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+38:11560:x1875683606351232:12345-192.168.201.29@tcp:36:rm.0 00010000:00010000:2.0:1788791585.406119:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788791585.406177:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323a10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367527e expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.406198:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a3239e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675277 expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.406210:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a3239ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675269 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.406219:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9ababb052f00) 00010000:00010000:2.0:1788791585.406229:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788791585.406247:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323a1e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.406274:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323a1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.406283:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323a1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.406298:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323a25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.406305:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323a25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.406312:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323a25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.406941:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323a2c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.406951:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323a2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.406960:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323a2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788791585.407958:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788791585.407970:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361787842391ns, next at 362787839666ns, rc = 0 00010000:00010000:2.0:1788791585.408035:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b600/0xcd6380150a323a33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.408047:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b600/0xcd6380150a323a33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.408065:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b600/0xcd6380150a323a33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.408073:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b600/0xcd6380150a323a33 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.408079:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b600/0xcd6380150a323a33 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.408085:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b600/0xcd6380150a323a33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.408124:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791585.408172:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323a2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.408178:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323a2c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.408183:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323a2c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.408189:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81a600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791585.408192:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323a2c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.408199:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323a2c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.408209:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:2.0:1788791585.408212:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788791585.408223:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323a2c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.408230:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323a2c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.408245:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323a1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.408252:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323a1e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.408258:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323a1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.408263:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81be00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791585.408266:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323a1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.408273:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323a1e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.408591:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791585.408598:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b600/0xcd6380150a323a33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.408605:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791585.408608:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b600/0xcd6380150a323a33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.408615:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b600/0xcd6380150a323a33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.408635:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:3.0:1788791585.408637:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788791585.408640:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b600/0xcd6380150a323a33 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.408646:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b600/0xcd6380150a323a33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.408659:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791585.408661:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791585.408663:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791585.409174:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:2.0:1788791585.409177:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791585.409180:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323a1e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.409187:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323a1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788791585.409199:0:5837:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000f753b642 reply state 0000000030dfe527 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323a25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791585.409218:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788791585.409817:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+37:11560:x1875683606351232:12345-192.168.201.29@tcp:36:rm.0 Request processed in 3699us (3893us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788791585.409826:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 198 00010000:00010000:3.0:1788791585.413020:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323a25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.413037:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323a25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.413045:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323a25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.413052:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81bc00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791585.413057:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323a25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.413064:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323a25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.413080:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9aba8533f300) 00010000:00010000:3.0:1788791585.413083:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791585.413087:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323a25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.413122:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323a25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.447889:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791585.461935:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791585.462024:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606351488 00000100:00100000:3.0:1788791585.462035:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606351488 00000100:00100000:3.0:1788791585.462099:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 199 00000100:00100000:0.0:1788791585.465093:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+36:11566:x1875683606351488:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1788791585.465145:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791585.465170:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323a3a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675285 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.465450:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323a41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.465483:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323a41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.465492:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323a41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.465504:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a323a48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.465511:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a323a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.465517:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a323a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788791585.466002:0:5836:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788791585.466206:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323a4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.466217:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.466224:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323a4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.466326:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323a41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.466331:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323a41 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.466336:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323a41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.466345:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791585.466348:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323a41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.466352:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323a41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.466361:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:0.0:1788791585.466363:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791585.466365:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323a41 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.466369:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323a41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788791585.466377:0:5836:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000008dd77c41 reply state 000000004b15e2e7 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a323a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791585.466383:0:5836:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788791585.466406:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323a3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675285 expref: 39 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.466415:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675285 expref: 38 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.466422:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9aba94530700) 00010000:00010000:0.0:1788791585.466424:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788791585.466426:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff000, rc 0) 00000100:00100000:0.0:1788791585.466567:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+39:11566:x1875683606351488:12345-192.168.201.29@tcp:101:bash.0 Request processed in 4458us (4641us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788791585.466581:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 199 00010000:00010000:1.0:1788791585.469527:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a323a48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.469547:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a323a48 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.469554:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a323a48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.469560:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fec00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791585.469565:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a323a48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.469573:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a323a48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.469589:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9aba94530a00) 00010000:00010000:1.0:1788791585.469592:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791585.469597:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a323a48 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.469622:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a323a48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791585.474690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791585.475118:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606351616 00000100:00100000:3.0:1788791585.475162:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606351616 00000100:00100000:3.0:1788791585.475215:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:3.0:1788791585.475226:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8508ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2353:x1875683606351616:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:3.0:1788791585.475254:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791585.475276:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a323a5d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367528c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788791585.475304:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791585.475323:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1788791585.475327:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791585.475337:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a323a5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367528c expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.475355:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a323a5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367528c expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.475369:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16de00, rc 0) 00000100:00100000:3.0:1788791585.475707:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8508ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2353:x1875683606351616:12345-192.168.201.29@tcp:101:bash.0 Request processed in 481us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791585.475728:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:2.0:1788791585.479783:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791585.479937:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606351744 00000100:00100000:0.0:1788791585.479947:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606351744 00000100:00100000:0.0:1788791585.480000:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:0.0:1788791585.480010:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:11566:x1875683606351744:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1788791585.480027:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791585.480045:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323a64 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675293 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.480074:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a323a5d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367528c expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.480080:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791585.480083:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791585.480087:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323a64 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675293 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.480260:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a323a5d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367528c expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.480274:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a323a5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367528c expref: 9 pid: 6682 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791585.480288:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1875683630457984:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791585.480453:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbaaad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788791585.483445:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791585.483547:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606351872 00000100:00100000:2.0:1788791585.483557:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606351872 00010000:00010000:2.0:1788791585.483601:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a323a5d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367528c expref: 10 pid: 6682 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791585.483649:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:2.0:1788791585.483659:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7986d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:2355:x1875683606351872:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791585.483674:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791585.483709:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a323a5d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367528c expref: 10 pid: 6682 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.483725:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a323a5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367528c expref: 10 pid: 6682 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.483758:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791585.483763:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791585.483771:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323a64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675293 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.483781:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323a64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675293 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.483835:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323a64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675293 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791585.483850:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb913b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1875683630458112:192.168.201.29@tcp:105: 00000100:00100000:2.0:1788791585.483941:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba84d0f300 going to sleep for 11 seconds 00010000:00010000:0.0:1788791585.484733:0:6681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040722bbd/0xcd6380150a323a5d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367528c expref: 10 pid: 6682 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791585.484751:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6681:1875683630457984:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788791585.484853:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323a64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675293 expref: 9 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.484865:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff600, rc 0) 00000100:00100000:0.0:1788791585.484920:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:11566:x1875683606351744:12345-192.168.201.29@tcp:101:bash.0 Request processed in 4911us (5146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791585.484929:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:2.0:1788791585.487028:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb913b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5822:1875683630458112:192.168.201.29@tcp:105: 00010000:00010000:2.0:1788791585.487053:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791585.487101:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7986d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2355:x1875683606351872:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 3443us (3666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791585.487119:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:3.0:1788791585.487633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791585.488210:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606352128 00000100:00100000:0.0:1788791585.488220:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606352128 00000100:00100000:0.0:1788791585.488267:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:0.0:1788791585.488278:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+38:11566:x1875683606352128:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:0.0:1788791585.488678:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+39:11566:x1875683606352128:12345-192.168.201.29@tcp:35:bash.0 Request processed in 400us (1044us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788791585.488697:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 55 00000100:00100000:1.0:1788791585.620852:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791585.621011:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606352256 00000100:00100000:3.0:1788791585.621022:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606352256 00000100:00100000:3.0:1788791585.621085:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 200 00000100:00100000:3.0:1788791585.621095:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+39:11582:x1875683606352256:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788791585.621153:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791585.621176:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323a6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367529a expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.621245:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323a72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.621259:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323a72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.621272:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323a72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791585.621326:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1788791585.621329:0:8351:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1788791585.621348:0:8351:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323a72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.621370:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323a6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367529a expref: 41 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.621388:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323a72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367529a expref: 40 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.621428:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:3.0:1788791585.621431:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788791585.621435:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c000, rc 0) 00000100:00100000:3.0:1788791585.621492:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+40:11582:x1875683606352256:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 399us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791585.621499:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 200 00000100:00100000:3.0:1788791585.626376:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791585.626569:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606352512 00000100:00100000:2.0:1788791585.626581:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606352512 00000100:00100000:2.0:1788791585.626634:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 201 00000100:00100000:2.0:1788791585.626646:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+40:11582:x1875683606352512:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791585.626667:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791585.626690:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323a79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536752a1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.626817:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323a80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.626832:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.626844:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791585.626865:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788791585.626990:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323a79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752a1 expref: 43 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.627008:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323a80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752a1 expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.627017:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9aba94530700) 00010000:00010000:2.0:1788791585.627020:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788791585.627024:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81a600, rc 0) 00000100:00100000:2.0:1788791585.627081:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+42:11582:x1875683606352512:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 437us (717us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788791585.627091:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 201 00000100:00100000:0.0:1788791585.634728:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791585.634776:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791585.634919:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606352896 00000100:00100000:1.0:1788791585.634929:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606352896 00000100:00100000:1.0:1788791585.635000:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:1.0:1788791585.635010:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+42:2354:x1875683606352896:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791585.635027:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791585.635051:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323a80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752a1 expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.635070:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9aba94530700) 00010000:00010000:1.0:1788791585.635075:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791585.635170:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+41:2354:x1875683606352896:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 161us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791585.635178:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:3.0:1788791585.635788:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606352768 00000100:00100000:3.0:1788791585.635795:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606352768 00000100:00100000:3.0:1788791585.635839:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 202 00000100:00100000:3.0:1788791585.635847:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+41:11582:x1875683606352768:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788791585.635867:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791585.635884:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323a8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536752a8 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.635978:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323a95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.635991:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323a95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.636001:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323a95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791585.636013:0:8351:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788791585.636168:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323a8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752a8 expref: 44 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.636204:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323a95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752a8 expref: 43 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.636212:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9aba94530700) 00010000:00010000:3.0:1788791585.636215:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788791585.636218:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c800, rc 0) 00000100:00100000:3.0:1788791585.636264:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+43:11582:x1875683606352768:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 417us (1545us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788791585.636271:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 202 00000100:00100000:0.0:1788791585.644340:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791585.644462:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606353024 00000100:00100000:1.0:1788791585.644473:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606353024 00000100:00100000:1.0:1788791585.644533:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:1.0:1788791585.644544:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2354:x1875683606353024:12345-192.168.201.29@tcp:1:lfs.0 00010000:00010000:1.0:1788791585.644590:0:12011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b01eec64/0xcd6380150a323aa3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.644610:0:12011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323a64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675293 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.644633:0:12011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788791585.644638:0:12011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788791585.644643:0:12011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b01eec64/0xcd6380150a323aa3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.644694:0:12011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323a64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675293 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.644710:0:12011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323a64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675293 expref: 8 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791585.644726:0:12011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab7985c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12011:1875683630458240:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791585.645032:0:12011:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae03000 going to sleep for 11 seconds 00000100:00100000:1.0:1788791585.648480:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791585.648721:0:12011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab7985c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12011:1875683630458240:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791585.648760:0:12011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b01eec64/0xcd6380150a323aa3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791585.648983:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606353152 00000100:00100000:3.0:1788791585.648990:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606353152 00002000:00100000:3.0:1788791585.649037:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ababb6d1500 x1875683606353152/t0(0) o4->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:296/0 lens 504/0 e 0 to 0 dl 1788791596 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788791585.649045:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ababb6d1500 with x1875683606353152 ext(0->8) 00010000:00010000:3.0:1788791585.649053:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323a64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675293 expref: 9 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.649066:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323a64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675293 expref: 9 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788791585.649073:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ababb6d1500 00000100:00100000:3.0:1788791585.649207:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:3.0:1788791585.649218:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2354:x1875683606353152:12345-192.168.201.29@tcp:4:lfs.0 00000100:00100000:3.0:1788791585.650013:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+11:2354:x1875683606353152:12345-192.168.201.29@tcp:4:lfs.0 Request processed in 793us (1597us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788791585.650029:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00002000:00100000:3.0:1788791585.650038:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9ababb6d1500 x1875683606353152/t4294967308(0) o4->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:296/0 lens 504/448 e 0 to 0 dl 1788791596 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788791585.650046:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ababb6d1500 with x1875683606353152 ext(0->8) 00010000:00010000:3.0:1788791585.650052:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323a64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675293 expref: 11 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.650066:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323a64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675293 expref: 11 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788791585.650072:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9ababb6d1500 00000100:00100000:0.0:1788791585.653344:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791585.653409:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606353280 00000100:00100000:3.0:1788791585.653474:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606353280 00010000:00010000:3.0:1788791585.653566:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323a64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675293 expref: 11 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791585.653647:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:3.0:1788791585.653656:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+11:2355:x1875683606353280:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791585.653670:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788791585.653697:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788791585.653700:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788791585 00002000:00010000:3.0:1788791585.653703:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788791585 00002000:00010000:3.0:1788791585.653705:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788791585 00010000:00010000:3.0:1788791585.653711:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323a64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675293 expref: 11 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.653749:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323a64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675293 expref: 11 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.653773:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323a64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675293 expref: 11 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.653789:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788791585.653793:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788791585.653799:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b01eec64/0xcd6380150a323aa3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.653809:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b01eec64/0xcd6380150a323aa3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.653839:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791585.653893:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:2355:x1875683606353280:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 238us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791585.653901:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 77 00010000:00010000:1.0:1788791585.653952:0:12011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b01eec64/0xcd6380150a323aa3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.653962:0:12011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b01eec64/0xcd6380150a323aa3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.653984:0:12011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b01eec64/0xcd6380150a323aa3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.653993:0:12011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b01eec64/0xcd6380150a323aa3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.654008:0:12011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b01eec64/0xcd6380150a323aa3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.654015:0:12011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791585.654019:0:12011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b01eec64/0xcd6380150a323aa3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.654027:0:12011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b01eec64/0xcd6380150a323aa3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.654039:0:12011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b01eec64/0xcd6380150a323aa3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.654046:0:12011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b01eec64/0xcd6380150a323aa3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791585.654085:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2354:x1875683606353024:12345-192.168.201.29@tcp:1:lfs.0 Request processed in 9544us (9756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791585.654092:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:1.0:1788791585.656986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791585.657091:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606353536 00000100:00100000:0.0:1788791585.657112:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606353536 00000100:00100000:0.0:1788791585.657299:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 56 00000100:00100000:0.0:1788791585.657310:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99283050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+43:11582:x1875683606353536:12345-192.168.201.29@tcp:35:lfs.0 00000004:00010000:0.0:1788791585.657373:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323a95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752a8 expref: 43 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788791585.657625:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1788791585.657667:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1788791585.658209:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1788791585.658273:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323aaa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.658289:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323a4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675285 expref: 47 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.658297:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323aaa lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.658331:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323a4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675285 expref: 47 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.658345:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323a4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675285 expref: 47 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791585.658358:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875683630458368:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791585.658485:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbaaad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788791585.662120:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791585.662224:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606353664 00000100:00100000:1.0:1788791585.662232:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606353664 00010000:00010000:1.0:1788791585.662268:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323a4f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675285 expref: 48 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791585.662316:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:1.0:1788791585.662325:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+48:2354:x1875683606353664:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791585.662338:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791585.662345:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323a4f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675285 expref: 48 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.662358:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323a4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675285 expref: 48 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.662378:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9aba94530700) 00010000:00010000:1.0:1788791585.662383:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323aaa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.662392:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323aaa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.662400:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323aaa lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.662427:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791585.662477:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+48:2354:x1875683606353664:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 153us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791585.662484:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 78 00010000:00010000:3.0:1788791585.663951:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323a4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675285 expref: 47 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791585.663975:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875683630458368:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791585.663999:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323aaa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.664291:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323aaa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.664300:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323aaa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788791585.664492:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788791585.664891:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1788791585.665010:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb913b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875683630458496:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788791585.665085:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791585.665262:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab2d7d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788791585.665334:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630458496 00000100:00100000:0.0:1788791585.665342:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630458496 00000100:00100000:0.0:1788791585.665438:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788791585.665456:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5840:x1875683630458496:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788791585.665564:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5840:x1875683630458496:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 109us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791585.665571:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788791585.665626:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb913b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875683630458496:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788791585.666030:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788791585.666082:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb913b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875683630458624:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788791585.666124:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791585.666751:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab2d7db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788791585.666869:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630458624 00000100:00100000:1.0:1788791585.666876:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630458624 00000100:00100000:1.0:1788791585.666909:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788791585.666918:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8627b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5840:x1875683630458624:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788791585.667120:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8627b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5840:x1875683630458624:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 203us (994us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788791585.667221:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb913b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875683630458624:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788791585.667271:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1788791585.667309:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323aaa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.667319:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323aaa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.667327:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323aaa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.667333:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fea00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791585.667338:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323aaa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.667345:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323aaa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.667360:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9aba94530700) 00010000:00010000:2.0:1788791585.667364:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788791585.667368:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323aaa lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.667385:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323aaa lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788791585.667559:0:5840:0:(mdd_object.c:4131:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788791585.667644:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788791585.667653:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362047526108ns, next at 363047524429ns, rc = 0 00000001:00080000:2.0:1788791585.667659:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788791585.667864:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9aba94530700) 00010000:00010000:2.0:1788791585.667868:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788791585.667874:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323a95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752a8 expref: 51 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791585.668008:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99283050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+50:11582:x1875683606353536:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 10699us (11030us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1788791585.668017:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 56 00000020:00080000:2.0:1788791585.668022:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788791585.668140:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788791585.670878:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791585.670961:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606353792 00000100:00100000:1.0:1788791585.670971:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606353792 00000100:00100000:1.0:1788791585.671026:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 203 00000100:00100000:1.0:1788791585.671038:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+50:11582:x1875683606353792:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788791585.671064:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791585.671089:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a323ab1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536752af expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.671185:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a323ab1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752af expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.671200:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a323ab1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752af expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.671220:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:1.0:1788791585.671224:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788791585.671227:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c01200, rc 0) 00000100:00100000:1.0:1788791585.671619:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+51:11582:x1875683606353792:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 582us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791585.671628:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 203 00000100:00100000:2.0:1788791585.675375:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791585.675524:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606354048 00000100:00100000:1.0:1788791585.675535:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606354048 00000100:00100000:1.0:1788791585.675595:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:1.0:1788791585.675606:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+51:11582:x1875683606354048:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788791585.675861:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:11582:x1875683606354048:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 256us (495us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788791585.675869:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 57 00000100:00100000:0.0:1788791585.768894:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791585.769076:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606354176 00000100:00100000:3.0:1788791585.769087:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606354176 00000100:00100000:3.0:1788791585.769211:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 204 00000100:00100000:3.0:1788791585.769222:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:11592:x1875683606354176:12345-192.168.201.29@tcp:34:lfs.0 00010000:00010000:3.0:1788791585.769297:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323ab8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.769315:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.769326:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.769341:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323abf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.769347:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.769353:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.769894:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.769906:0:8351:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.769915:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788791585.769956:0:8351:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.769987:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.769994:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323ab8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770001:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770007:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791585.770012:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770020:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323ab8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770032:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:2.0:1788791585.770035:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791585.770040:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323ab8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770046:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323ab8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770061:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770068:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323abf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770074:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770084:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791585.770087:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770093:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323abf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770111:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9aba8823c200) 00010000:00010000:2.0:1788791585.770114:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791585.770117:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323abf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770123:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323abf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770176:0:8351:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770182:0:8351:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770187:0:8351:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770192:0:8351:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81be00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791585.770195:0:8351:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770201:0:8351:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770219:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:2.0:1788791585.770221:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791585.770224:0:8351:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323ac6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.770230:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323ac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8351 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791585.770320:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:11592:x1875683606354176:12345-192.168.201.29@tcp:34:lfs.0 Request processed in 1098us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791585.770328:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 204 00000100:00100000:3.0:1788791585.813056:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791585.813192:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606354432 00000100:00100000:0.0:1788791585.813203:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606354432 00000100:00100000:0.0:1788791585.813271:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 205 00000100:00100000:0.0:1788791585.813283:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+52:11595:x1875683606354432:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791585.813307:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791585.813328:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323acd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536752b6 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813405:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323ad4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813436:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813447:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813465:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323adb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813472:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813478:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813634:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323ae2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813644:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813651:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791585.813661:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788791585.813760:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813767:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323ad4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813774:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813779:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ffc00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791585.813784:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813791:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323ad4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813802:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:0.0:1788791585.813805:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791585.813810:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323ad4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813827:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323ad4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813843:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813849:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323adb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813855:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323adb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813860:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fea00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791585.813863:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323adb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813869:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323adb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813877:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9aba94530700) 00010000:00010000:0.0:1788791585.813880:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791585.813883:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323adb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813889:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323adb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813930:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a323acd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752b6 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813945:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752b6 expref: 54 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.813959:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:0.0:1788791585.813961:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788791585.813963:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff000, rc 0) 00000100:00100000:0.0:1788791585.814043:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:11595:x1875683606354432:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 761us (995us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788791585.814052:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 205 00000100:00100000:0.0:1788791585.824219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791585.824304:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606354560 00000100:00100000:2.0:1788791585.824315:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606354560 00000100:00100000:2.0:1788791585.824388:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 206 00000100:00100000:2.0:1788791585.824400:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:11595:x1875683606354560:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:2.0:1788791585.824468:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323af0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.824486:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323af0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.824497:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323af0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.824535:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323af0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.824542:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323af0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.824565:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323af0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.824571:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81ba00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791585.824576:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323af0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.824583:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323af0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.824596:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:2.0:1788791585.824599:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788791585.824604:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323af0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.824610:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323af0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791585.824688:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:11595:x1875683606354560:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 291us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791585.824696:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 206 00000100:00100000:2.0:1788791585.830216:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791585.830484:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606354816 00000100:00100000:1.0:1788791585.830495:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606354816 00000100:00100000:1.0:1788791585.830584:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:1.0:1788791585.830595:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+54:11595:x1875683606354816:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788791585.830831:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:11595:x1875683606354816:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 237us (623us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788791585.830838:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 58 00000100:00100000:3.0:1788791585.922627:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791585.922754:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606355072 00000100:00100000:0.0:1788791585.922764:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606355072 00000100:00100000:0.0:1788791585.922825:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 207 00000100:00100000:0.0:1788791585.922835:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:11605:x1875683606355072:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:0.0:1788791585.922858:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791585.922861:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788791585.922887:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c000/0xcd6380150a323a72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367529a expref: 55 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.922907:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:0.0:1788791585.922913:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788791585.922926:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323af7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536752bd expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.923038:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323afe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.923053:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323ae2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752b6 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.923076:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323afe lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.923174:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752b6 expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.923189:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323ae2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752b6 expref: 55 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791585.923203:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630458752:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791585.923302:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbaaab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788791585.929548:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791585.929875:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630458752:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791585.929905:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323afe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791585.930034:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606355200 00000100:00100000:2.0:1788791585.930042:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606355200 00010000:00010000:2.0:1788791585.930080:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323ae2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752b6 expref: 56 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791585.930170:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:2.0:1788791585.930181:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+56:2354:x1875683606355200:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791585.930210:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791585.930217:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323ae2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752b6 expref: 56 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.930230:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752b6 expref: 56 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.930252:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a323ae2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752b6 expref: 56 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.930267:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:2.0:1788791585.930272:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323afe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.930295:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323afe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.930302:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323afe lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791585.930332:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791585.930455:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:2354:x1875683606355200:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 275us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791585.930463:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 79 00010000:00010000:0.0:1788791585.930659:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323afe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.930668:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323afe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791585.930686:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788791585.930841:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323af7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752bd expref: 56 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.930856:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323afe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752bd expref: 55 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.930863:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:0.0:1788791585.930865:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788791585.930875:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ffc00, rc 0) 00000100:00100000:0.0:1788791585.930902:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2da3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:11605:x1875683606355072:12345-192.168.201.29@tcp:101:bash.0 Request processed in 8069us (8286us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788791585.930908:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 207 00000100:00100000:2.0:1788791585.936272:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791585.936663:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606355456 00000100:00100000:1.0:1788791585.936685:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606355456 00000100:00100000:1.0:1788791585.936755:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 208 00000100:00100000:1.0:1788791585.936767:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+55:11605:x1875683606355456:12345-192.168.201.29@tcp:36:bash.0 00010000:00010000:1.0:1788791585.937032:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323b0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.937049:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323b0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.937060:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323b0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788791585.937120:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1788791585.937189:0:5837:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000003a0680b1 reply state 00000000dd8cad16 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323b0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791585.937198:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788791585.937299:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+58:11605:x1875683606355456:12345-192.168.201.29@tcp:36:bash.0 Request processed in 533us (1035us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788791585.937307:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 208 00000020:00080000:1.0:1788791585.937312:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788791585.940315:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323b0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.940344:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323b0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.940353:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323b0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.940359:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791585.940364:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323b0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.940371:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323b0c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.940387:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:3.0:1788791585.940391:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791585.940396:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323b0c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791585.940402:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323b0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791585.942221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791585.942455:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606355584 00000100:00100000:1.0:1788791585.942464:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606355584 00000100:00100000:1.0:1788791585.942529:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 209 00000100:00100000:1.0:1788791585.942541:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:11605:x1875683606355584:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788791585.942566:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791585.942587:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323b13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536752c4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.942683:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323b1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.942697:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323afe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752bd expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.942706:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323b1a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.942962:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323afe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752bd expref: 58 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.942976:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323afe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752bd expref: 58 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791585.942989:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875683630458880:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791585.943070:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae03a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788791585.946253:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791585.946383:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875683630458880:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791585.946420:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323b1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791585.946861:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606355712 00000100:00100000:0.0:1788791585.946870:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606355712 00010000:00010000:0.0:1788791585.946908:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323afe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752bd expref: 59 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791585.946984:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:0.0:1788791585.946994:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+59:2355:x1875683606355712:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788791585.947013:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791585.947020:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323afe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752bd expref: 59 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.947032:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323afe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752bd expref: 59 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.947052:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323afe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752bd expref: 59 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.947067:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:0.0:1788791585.947071:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323b1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.947079:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791585.947087:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323b1a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.947231:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323b1a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.947239:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323b1a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791585.947286:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788791585.947291:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791585.947311:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323b1a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.947341:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323b13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752c4 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.947357:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323b1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752c4 expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791585.947364:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:1.0:1788791585.947366:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788791585.947369:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c00000, rc 0) 00000100:00100000:1.0:1788791585.947442:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+58:11605:x1875683606355584:12345-192.168.201.29@tcp:101:bash.0 Request processed in 4903us (5229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791585.947449:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 209 00010000:00010000:0.0:1788791585.947608:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791585.947631:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:2355:x1875683606355712:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 638us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791585.947639:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:2.0:1788791585.951058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791585.951185:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606355968 00000100:00100000:0.0:1788791585.951196:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606355968 00000100:00100000:0.0:1788791585.951246:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:0.0:1788791585.951256:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+57:11605:x1875683606355968:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:0.0:1788791585.951515:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+58:11605:x1875683606355968:12345-192.168.201.29@tcp:35:bash.0 Request processed in 260us (468us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788791585.951523:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 59 00000100:00100000:2.0:1788791586.015992:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791586.016178:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606356096 00000100:00100000:1.0:1788791586.016188:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606356096 00000100:00100000:1.0:1788791586.016253:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 210 00000100:00100000:1.0:1788791586.016264:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+58:11611:x1875683606356096:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788791586.016289:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791586.016326:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323b21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536752cb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.016396:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323b28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.016423:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323b28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.016434:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323b28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791586.016490:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1788791586.016494:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791586.016531:0:5837:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323b28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.016555:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323b21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752cb expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.016572:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323b28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752cb expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.016580:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:1.0:1788791586.016582:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788791586.016586:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c01000, rc 0) 00000100:00100000:1.0:1788791586.016644:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+59:11611:x1875683606356096:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 382us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791586.016651:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 210 00000100:00100000:3.0:1788791586.021295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791586.021418:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606356224 00000100:00100000:0.0:1788791586.021430:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606356224 00000100:00100000:0.0:1788791586.021488:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 211 00000100:00100000:0.0:1788791586.021498:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+59:11611:x1875683606356224:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:0.0:1788791586.021530:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791586.021551:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323b2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536752d2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021613:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323b36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021627:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021638:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021664:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021672:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021688:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021792:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323b44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021801:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021807:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791586.021851:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788791586.021856:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788791586.021874:0:5836:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021885:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021893:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323b36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021899:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323b36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021915:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021922:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fea00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791586.021926:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323b36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021934:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323b36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021946:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:0.0:1788791586.021950:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791586.021954:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323b36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021961:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323b36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021975:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021982:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021988:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.021993:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ffa00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791586.021995:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.022012:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.022020:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9aba94530700) 00010000:00010000:0.0:1788791586.022022:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791586.022025:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.022031:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.022063:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffc00/0xcd6380150a323b2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d2 expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.022077:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d2 expref: 60 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.022085:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:0.0:1788791586.022087:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788791586.022090:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff600, rc 0) 00000100:00100000:0.0:1788791586.022210:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+60:11611:x1875683606356224:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 713us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791586.022219:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 211 00000100:00100000:2.0:1788791586.026632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791586.026694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791586.026900:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606356480 00000100:00100000:1.0:1788791586.026925:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606356480 00000100:00100000:1.0:1788791586.026997:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 212 00000100:00100000:1.0:1788791586.027007:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+60:11611:x1875683606356480:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788791586.027028:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791586.027049:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323b4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536752d9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.027204:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.027220:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323b1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752c4 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.027227:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323b44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d2 expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.027236:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.027276:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d2 expref: 61 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.027289:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323b44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d2 expref: 61 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791586.027303:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875683630459008:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791586.027382:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323b1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752c4 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.027401:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323b1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752c4 expref: 61 pid: 5839 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791586.027424:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875683630459136:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791586.027447:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae03480 going to sleep for 11 seconds 00000100:00100000:0.0:1788791586.028174:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606356608 00000100:00100000:0.0:1788791586.028184:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606356608 00010000:00010000:0.0:1788791586.028222:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323b44 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d2 expref: 62 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791586.028271:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:0.0:1788791586.028281:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa001d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+62:2352:x1875683606356608:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788791586.028293:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791586.028299:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323b44 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d2 expref: 62 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.028311:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323b44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d2 expref: 62 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.028331:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:0.0:1788791586.028336:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.028343:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.028349:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791586.028525:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa001d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+62:2352:x1875683606356608:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 244us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791586.028533:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:2.0:1788791586.033947:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791586.034600:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606356736 00000100:00100000:3.0:1788791586.034610:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606356736 00010000:00010000:3.0:1788791586.034652:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323b1a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752c4 expref: 62 pid: 5839 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791586.034708:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:3.0:1788791586.034719:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+62:2354:x1875683606356736:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791586.034968:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791586.034976:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323b1a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752c4 expref: 62 pid: 5839 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.034991:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323b1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752c4 expref: 62 pid: 5839 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.035013:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:3.0:1788791586.035019:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.035028:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.035036:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.035055:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791586.035114:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+62:2354:x1875683606356736:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 397us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791586.035122:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 82 00010000:00010000:1.0:1788791586.037204:0:5837:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.29@tcp) returned -22 from blocking AST (req@00000000afe44811 x1875683630459008) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323b44 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d2 expref: 61 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.037230:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a323b44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d2 expref: 61 pid: 5836 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791586.037247:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875683630459008:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791586.037265:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323b1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752c4 expref: 60 pid: 5839 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791586.037276:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875683630459136:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791586.037297:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:1.0:1788791586.037305:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.037314:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.037319:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791586.037356:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788791586.037835:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00e00/0xcd6380150a323b4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d9 expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.037918:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d9 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.037927:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:1.0:1788791586.037929:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788791586.037932:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c01c00, rc 0) 00000100:00100000:1.0:1788791586.037994:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb702300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+60:11611:x1875683606356480:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 10987us (11372us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788791586.038002:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 212 00000100:00100000:0.0:1788791586.041124:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791586.041301:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606356992 00000100:00100000:3.0:1788791586.041310:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606356992 00000100:00100000:3.0:1788791586.041370:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:3.0:1788791586.041379:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+60:11611:x1875683606356992:12345-192.168.201.29@tcp:103:lfs.0 00010000:00010000:3.0:1788791586.041392:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791586.041423:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01200/0xcd6380150a323ab1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752af expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.041457:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:3.0:1788791586.041462:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791586.041544:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+59:11611:x1875683606356992:12345-192.168.201.29@tcp:103:lfs.0 Request processed in 166us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791586.041552:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1788791586.044106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791586.044224:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606357120 00000100:00100000:0.0:1788791586.044235:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606357120 00000100:00100000:0.0:1788791586.044295:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 213 00000100:00100000:0.0:1788791586.044307:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+59:11611:x1875683606357120:12345-192.168.201.29@tcp:58:lfs.0 00010000:00010000:0.0:1788791586.044417:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b60 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.044449:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.044460:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788791586.044642:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788791586.044722:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+59:11611:x1875683606357120:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 416us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791586.044729:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 213 00000100:00100000:1.0:1788791586.047599:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791586.047915:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606357248 00000100:00100000:2.0:1788791586.047928:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606357248 00000100:00100000:2.0:1788791586.047991:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 214 00000100:00100000:2.0:1788791586.048002:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+59:11611:x1875683606357248:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791586.048021:0:8351:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791586.048040:0:8351:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a400/0xcd6380150a323b67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536752e0 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.048390:0:8351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b60 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.048403:0:8351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a400/0xcd6380150a323b67 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752e0 expref: 60 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.048487:0:8351:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.048500:0:8351:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a400/0xcd6380150a323b67 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752e0 expref: 60 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.048524:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:2.0:1788791586.048527:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788791586.048542:0:8351:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a400/0xcd6380150a323b67 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752e0 expref: 60 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.048550:0:8351:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81a400, rc 0) 00000100:00100000:2.0:1788791586.048646:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+60:11611:x1875683606357248:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 646us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791586.048652:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 214 00000100:00100000:2.0:1788791586.085614:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630459264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791586.086382:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2e09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630459392:0@lo:400:kworker.0 00000100:00100000:1.0:1788791586.086448:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791586.086490:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab30e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630459904:0@lo:400:kworker.0 00000100:00100000:1.0:1788791586.086512:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791586.086535:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791586.086540:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab30e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630459520:0@lo:400:kworker.0 00000100:00100000:1.0:1788791586.086559:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791586.086582:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630459392 00000100:00100000:1.0:1788791586.086590:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630459392 00000100:00100000:1.0:1788791586.086628:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788791586.086635:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630459392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791586.086699:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630459392:12345-0@lo:400:kworker.0 Request processed in 64us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791586.086707:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788791586.086750:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2e09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630459392:0@lo:400:kworker.0 00000100:00100000:0.0:1788791586.087179:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630459520 00000100:00100000:0.0:1788791586.087185:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630459520 00000100:00100000:0.0:1788791586.087220:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788791586.087228:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630459520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791586.087272:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630459520:12345-0@lo:400:kworker.0 Request processed in 45us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791586.087278:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788791586.087935:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab30e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630459520:0@lo:400:kworker.0 00000100:00100000:2.0:1788791586.088010:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791586.088035:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630459264 00000100:00100000:2.0:1788791586.088040:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab30e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630459776:0@lo:400:kworker.0 00000100:00100000:1.0:1788791586.088040:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630459264 00000100:00100000:2.0:1788791586.088068:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791586.088079:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788791586.088085:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875683630459264:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791586.088086:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788791586.088092:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab30e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630459648:0@lo:400:kworker.0 00000100:00100000:2.0:1788791586.088138:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788791586.088139:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791586.088168:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630459776 00000100:00100000:2.0:1788791586.088172:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630459776 00000100:00100000:1.0:1788791586.088173:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875683630459264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791586.088179:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788791586.088196:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630459648 00000100:00080000:1.0:1788791586.088197:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791586.088199:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630459648 00000100:00080000:1.0:1788791586.088202:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788791586.088205:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791586.088214:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788791586.088218:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788791586.088220:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630459776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791586.088223:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630459648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791586.088250:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875683630459776:12345-0@lo:400:kworker.0 Request processed in 30us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791586.088256:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788791586.088771:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630459648:12345-0@lo:400:kworker.0 Request processed in 545us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791586.088778:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788791586.088817:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab30e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630459648:0@lo:400:kworker.0 00000100:00100000:2.0:1788791586.088839:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630459264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791586.088849:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab30e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630459776:0@lo:400:kworker.0 00000100:00100000:2.0:1788791586.089208:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630459904 00000100:00100000:2.0:1788791586.089215:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630459904 00000100:00100000:2.0:1788791586.089268:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788791586.089278:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875683630459904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791586.089321:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875683630459904:12345-0@lo:400:kworker.0 Request processed in 45us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791586.089332:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788791586.097745:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab30e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630459904:0@lo:400:kworker.0 00000001:00080000:3.0:1788791586.176511:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1788791586.176605:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000040:00080000:3.0:1788791586.278258:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788791586.278269:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788791586.278328:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788791586.278342:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788791586.278470:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d58700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875683630460032:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788791586.278605:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788791586.285478:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d58700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875683630460032:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788791586.289389:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791586.289643:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606357376 00000100:00100000:2.0:1788791586.289652:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606357376 00000100:00100000:2.0:1788791586.289718:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 215 00000100:00100000:2.0:1788791586.289729:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+60:11612:x1875683606357376:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788791586.289761:0:5837:0:(mdt_handler.c:8010:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788791586.289864:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+60:11612:x1875683606357376:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 136us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791586.289871:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 215 00000100:00100000:1.0:1788791586.292962:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791586.295570:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606357504 00000100:00100000:2.0:1788791586.295585:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606357504 00000100:00100000:2.0:1788791586.295728:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 216 00000100:00100000:2.0:1788791586.295741:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+60:11612:x1875683606357504:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788791586.295812:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323b6e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.295829:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323b6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.295842:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323b6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.295876:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a000/0xcd6380150a323b75 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.295884:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a000/0xcd6380150a323b75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.295890:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a000/0xcd6380150a323b75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.295911:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a200/0xcd6380150a323b7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.295919:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a200/0xcd6380150a323b7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.295926:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a200/0xcd6380150a323b7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791586.295964:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788791586.295968:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788791586.295979:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a200/0xcd6380150a323b7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.295990:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323b6e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.295996:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323b6e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296003:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323b6e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296018:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b800 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791586.296022:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323b6e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296029:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323b6e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296040:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9aba8823c000) 00010000:00010000:2.0:1788791586.296043:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791586.296048:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323b6e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296054:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323b6e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296067:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a000/0xcd6380150a323b75 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296072:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a000/0xcd6380150a323b75 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296078:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a000/0xcd6380150a323b75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296082:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81a000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791586.296085:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a000/0xcd6380150a323b75 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296101:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a000/0xcd6380150a323b75 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296119:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9aba8533ff00) 00010000:00010000:2.0:1788791586.296121:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791586.296124:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a000/0xcd6380150a323b75 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296184:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a000/0xcd6380150a323b75 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296198:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a200/0xcd6380150a323b7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296203:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a200/0xcd6380150a323b7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296209:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a200/0xcd6380150a323b7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296213:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81a200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791586.296216:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a200/0xcd6380150a323b7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296221:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a200/0xcd6380150a323b7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296228:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:2.0:1788791586.296240:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791586.296243:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a200/0xcd6380150a323b7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.296249:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a200/0xcd6380150a323b7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791586.296354:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+60:11612:x1875683606357504:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 614us (3399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791586.296362:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 216 00000100:00100000:3.0:1788791586.303255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791586.312063:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606357760 00000100:00100000:0.0:1788791586.312078:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606357760 00000100:00100000:0.0:1788791586.312184:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 217 00000100:00100000:0.0:1788791586.312195:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+60:11612:x1875683606357760:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788791586.312217:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791586.312612:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323b83 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536752e7 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.312847:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323b8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.312881:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323b8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.312893:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323b8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791586.312905:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788791586.313001:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323b8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.313009:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323b8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.313015:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323b8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.313022:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fee00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791586.313026:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323b8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.313033:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323b8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.313045:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:0.0:1788791586.313048:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788791586.313053:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323b8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.313060:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323b8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.313112:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323b83 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752e7 expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.313242:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9aba8823c000) 00010000:00010000:0.0:1788791586.313245:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788791586.313250:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a323b83 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752e7 expref: 62 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.313262:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fea00, rc 0) 00000100:00100000:0.0:1788791586.313345:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+61:11612:x1875683606357760:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1151us (10100us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788791586.313353:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 217 00000100:00100000:3.0:1788791586.317464:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791586.317935:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606357888 00000100:00100000:0.0:1788791586.317945:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606357888 00000100:00100000:0.0:1788791586.318008:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 218 00000100:00100000:0.0:1788791586.318019:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+61:11612:x1875683606357888:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788791586.318055:0:8351:0:(mdt_handler.c:8010:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788791586.318189:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+61:11612:x1875683606357888:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 171us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791586.318196:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 218 00000100:00100000:3.0:1788791586.322061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791586.322275:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606358144 00000100:00100000:2.0:1788791586.322293:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606358144 00000100:00100000:2.0:1788791586.322347:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 219 00000100:00100000:2.0:1788791586.322357:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+61:11612:x1875683606358144:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788791586.322377:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791586.322380:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788791586.322416:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01000/0xcd6380150a323b28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752cb expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.322435:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:2.0:1788791586.322441:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788791586.322454:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323b98 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536752ee expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788791586.323179:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788791586.324869:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323b9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.324891:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.324902:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.324965:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323b98 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752ee expref: 63 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.325001:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323b9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752ee expref: 62 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.325010:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9aba8533fa00) 00010000:00010000:2.0:1788791586.325013:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788791586.325016:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81b400, rc 0) 00000100:00100000:2.0:1788791586.325102:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+62:11612:x1875683606358144:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 2736us (3040us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788791586.325111:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 219 00000100:00100000:3.0:1788791586.328552:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791586.329383:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606358400 00000100:00100000:2.0:1788791586.329394:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606358400 00000100:00100000:2.0:1788791586.329465:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 220 00000100:00100000:2.0:1788791586.329475:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+62:11612:x1875683606358400:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788791586.329542:0:5836:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791586.329570:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323b9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752ee expref: 62 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.329588:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9aba8533fa00) 00010000:00010000:2.0:1788791586.329600:0:5836:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788791586.329620:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323bad lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.329635:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323bad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.329645:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323bad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.329946:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323bb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xebb47504 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.329956:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xebb47504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.329964:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xebb47504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.330038:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323bad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.330045:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323bad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.330051:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323bad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.330057:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81ba00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791586.330061:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323bad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.330068:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323bad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.330076:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:2.0:1788791586.330079:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791586.330083:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323bad lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.330088:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323bad lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.330116:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xebb47504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.330121:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323bb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xebb47504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.330325:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323bb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xebb47504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.330331:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81be00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791586.330334:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323bb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xebb47504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.330340:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323bb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xebb47504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.330348:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xebb47504 (ffff9aba8533f300) 00010000:00010000:2.0:1788791586.330350:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791586.330353:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323bb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xebb47504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.330359:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81be00/0xcd6380150a323bb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xebb47504 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791586.330652:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+61:11612:x1875683606358400:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 1176us (2107us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788791586.330661:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 220 00000100:00100000:3.0:1788791586.333346:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791586.333445:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606358528 00000100:00100000:2.0:1788791586.333454:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606358528 00000100:00100000:2.0:1788791586.333520:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 221 00000100:00100000:2.0:1788791586.333544:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+61:11612:x1875683606358528:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788791586.333562:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791586.333583:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323bbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536752f5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.333618:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a323bc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.333632:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a323bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.333642:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a323bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.333748:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323bbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752f5 expref: 63 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.333770:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a323bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752f5 expref: 62 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.333780:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:2.0:1788791586.333783:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788791586.333786:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81aa00, rc 0) 00000100:00100000:2.0:1788791586.333845:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+62:11612:x1875683606358528:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 303us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791586.333852:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 221 00000100:00100000:3.0:1788791586.338240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791586.338510:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606358784 00000100:00100000:1.0:1788791586.338531:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606358784 00000100:00100000:1.0:1788791586.338587:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 222 00000100:00100000:1.0:1788791586.338596:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+62:11612:x1875683606358784:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788791586.338672:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323bc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.338693:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.338703:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788791586.338933:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:1.0:1788791586.339028:0:5837:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000818bde28 reply state 00000000f2c6aac1 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791586.339037:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788791586.339168:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+64:11612:x1875683606358784:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 571us (947us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788791586.339175:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 222 00010000:00010000:1.0:1788791586.341535:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323bc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.341551:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323bc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.341559:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323bc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.341564:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791586.341569:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323bc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.341590:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323bc9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.341607:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:1.0:1788791586.341610:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788791586.341614:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323bc9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.341621:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323bc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791586.343436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791586.344471:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606358912 00000100:00100000:2.0:1788791586.344486:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606358912 00000100:00100000:2.0:1788791586.344589:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 223 00000100:00100000:2.0:1788791586.344614:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+63:11612:x1875683606358912:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788791586.344637:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791586.344658:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323bd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536752fc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.344733:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752fc expref: 64 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.344748:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752fc expref: 64 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.344767:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:2.0:1788791586.344770:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788791586.344773:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81a600, rc 0) 00000100:00100000:2.0:1788791586.344836:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+64:11612:x1875683606358912:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 225us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791586.344844:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 223 00000100:00100000:3.0:1788791586.347249:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791586.347399:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606359040 00000100:00100000:1.0:1788791586.347418:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606359040 00000100:00100000:1.0:1788791586.347470:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:1.0:1788791586.347480:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2355:x1875683606359040:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788791586.347882:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:2355:x1875683606359040:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 402us (640us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788791586.347892:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:3.0:1788791586.350183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791586.350520:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606359296 00000100:00100000:1.0:1788791586.350531:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606359296 00000100:00100000:1.0:1788791586.350585:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:1.0:1788791586.350595:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+64:11612:x1875683606359296:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788791586.350904:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+65:11612:x1875683606359296:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 309us (775us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788791586.350912:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 60 00000100:00100000:1.0:1788791586.353952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791586.354071:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606359552 00000100:00100000:2.0:1788791586.354081:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606359552 00000100:00100000:2.0:1788791586.354411:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 224 00000100:00100000:2.0:1788791586.354425:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+65:11612:x1875683606359552:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788791586.354542:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+65:11612:x1875683606359552:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 120us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791586.354549:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 224 00000100:00100000:1.0:1788791586.356999:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791586.358304:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606359680 00000100:00100000:0.0:1788791586.358318:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606359680 00000100:00100000:1.0:1788791586.358573:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 225 00000100:00100000:1.0:1788791586.358583:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+65:11612:x1875683606359680:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788791586.358603:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791586.358624:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323bd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675303 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.359555:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a323bde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.359572:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a323bde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.359584:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a323bde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791586.359620:0:5836:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791586.359639:0:5836:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a323bde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.359679:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00000/0xcd6380150a323bd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675303 expref: 67 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.360217:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a323bde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675303 expref: 66 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.360226:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:1.0:1788791586.360305:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788791586.360310:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c00200, rc 0) 00000100:00100000:1.0:1788791586.360383:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2e09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+66:11612:x1875683606359680:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1800us (3393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791586.360473:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 225 00000100:00100000:2.0:1788791586.365280:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791586.365361:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606359808 00000100:00100000:0.0:1788791586.365370:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606359808 00000100:00100000:0.0:1788791586.365430:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:0.0:1788791586.365441:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+10:2354:x1875683606359808:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788791586.365458:0:12011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791586.365479:0:12011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323be5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367530a expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788791586.365520:0:12011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ecb22, blocks: 0x1 00010000:00010000:0.0:1788791586.365541:0:12011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=362s v=(0 0) 00010000:00010000:0.0:1788791586.365545:0:12011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791586.365554:0:12011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323be5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367530a expref: 11 pid: 12011 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.365573:0:12011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323be5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367530a expref: 11 pid: 12011 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.365586:0:12011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fee00, rc 0) 00000100:00100000:0.0:1788791586.365650:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+11:2354:x1875683606359808:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 209us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791586.365657:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:2.0:1788791586.371026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791586.371829:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606360064 00000100:00100000:3.0:1788791586.371841:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606360064 00000100:00100000:3.0:1788791586.371908:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 226 00000100:00100000:3.0:1788791586.371919:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+66:11612:x1875683606360064:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788791586.372033:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+66:11612:x1875683606360064:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 116us (1017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791586.372042:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 226 00000100:00100000:3.0:1788791586.377421:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791586.377619:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606360192 00000100:00100000:2.0:1788791586.377628:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606360192 00000100:00100000:2.0:1788791586.377704:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:2.0:1788791586.377714:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+11:11612:x1875683606360192:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788791586.377734:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791586.377753:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d5d2433/0xcd6380150a323bec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675311 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.377787:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323be5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367530a expref: 12 pid: 12011 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.377797:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791586.377801:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791586.377807:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d5d2433/0xcd6380150a323bec lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675311 expref: 12 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.377844:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323be5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367530a expref: 12 pid: 12011 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.377858:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323be5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367530a expref: 12 pid: 12011 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791586.377871:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab30e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875683630460160:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788791586.377954:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab2d7d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788791586.386260:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791586.386446:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab30e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875683630460160:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791586.386480:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000d5d2433/0xcd6380150a323bec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675311 expref: 12 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.386528:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81be00, rc 0) 00000100:00100000:2.0:1788791586.386587:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+12:11612:x1875683606360192:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 8873us (9186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791586.386595:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:3.0:1788791586.387171:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606360320 00000100:00100000:3.0:1788791586.387179:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606360320 00010000:00010000:3.0:1788791586.387212:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323be5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367530a expref: 12 pid: 12011 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791586.387247:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:3.0:1788791586.387257:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+12:2355:x1875683606360320:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791586.387271:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791586.387293:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323be5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367530a expref: 12 pid: 12011 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.387307:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323be5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367530a expref: 12 pid: 12011 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.387330:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323be5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367530a expref: 12 pid: 12011 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.387344:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791586.387350:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791586.387366:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000d5d2433/0xcd6380150a323bec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675311 expref: 11 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.387376:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d5d2433/0xcd6380150a323bec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675311 expref: 11 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.387416:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000d5d2433/0xcd6380150a323bec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675311 expref: 11 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791586.387430:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d5bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1875683630460288:192.168.201.29@tcp:105: 00000100:00100000:3.0:1788791586.387496:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a3840 going to sleep for 11 seconds 00000100:00100000:0.0:1788791586.409326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791586.409606:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d5bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1875683630460288:192.168.201.29@tcp:105: 00010000:00010000:3.0:1788791586.409630:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791586.409702:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+11:2355:x1875683606360320:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 22446us (23451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791586.409714:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:2.0:1788791586.409900:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606360448 00000100:00100000:2.0:1788791586.409907:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606360448 00002000:00100000:2.0:1788791586.409953:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9ababb6d4380 x1875683606360448/t0(0) o4->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:297/0 lens 504/0 e 0 to 0 dl 1788791597 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788791586.409963:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ababb6d4380 with x1875683606360448 ext(0->12) 00002000:00010000:2.0:1788791586.409968:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ababb6d4380 00000100:00100000:2.0:1788791586.409998:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:2.0:1788791586.410007:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+11:2355:x1875683606360448:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788791586.410615:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:2355:x1875683606360448:12345-192.168.201.29@tcp:4:lhsmtool_posix.0 Request processed in 607us (1296us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788791586.410623:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00002000:00100000:2.0:1788791586.410631:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9ababb6d4380 x1875683606360448/t4294967320(0) o4->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:297/0 lens 504/448 e 0 to 0 dl 1788791597 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788791586.410642:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9ababb6d4380 with x1875683606360448 ext(0->12) 00002000:00010000:2.0:1788791586.410645:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9ababb6d4380 00000100:00100000:0.0:1788791586.413966:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791586.414204:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606360576 00000100:00100000:1.0:1788791586.414214:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606360576 00000100:00100000:1.0:1788791586.414291:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 227 00000100:00100000:1.0:1788791586.414302:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+66:11612:x1875683606360576:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00010000:00010000:3.0:1788791586.468234:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791586.538665:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+66:11612:x1875683606360576:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 124354us (124697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791586.538679:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 227 00000001:00080000:0.0:1788791586.539367:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000001:00080000:0.0:1788791586.539415:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:0.0:1788791586.539441:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9abab2d7dc00 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788791586.539446:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9abab30fea00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9abab2d7d6c0 00000020:00080000:0.0:1788791586.539449:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9abab30fe000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9aba8325bc00 00000020:00080000:0.0:1788791586.539469:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:0.0:1788791586.539482:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788791586.539505:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9abab2d7de40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788791586.539516:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9aba87c8a400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9abab2d7d000 00000020:00080000:0.0:1788791586.539519:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9aba87c8ae00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ababb81f400 00000004:00080000:0.0:1788791586.539530:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:0.0:1788791586.539931:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630460416:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788791586.539986:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791586.540116:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630460416 00000100:00100000:3.0:1788791586.540124:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630460416 00000100:00100000:3.0:1788791586.540194:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788791586.540204:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3315:x1875683630460416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788791586.540227:0:10087:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1788791586.540262:0:10087:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323bf3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.540284:0:10087:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a3239b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675270 expref: 12 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.540307:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788791586.540311:0:10087:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788791586.540315:0:10087:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323bf3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.540342:0:10087:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a3239b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675270 expref: 12 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.540356:0:10087:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a3239b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675270 expref: 12 pid: 6683 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791586.540367:0:10087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10087:1875683630460544:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788791586.540426:0:10087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850a3840 going to sleep for 11 seconds 00000100:00100000:2.0:1788791586.540698:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788791586.540710:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab30e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630460672:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788791586.540758:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791586.540787:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630460672 00000100:00100000:2.0:1788791586.540792:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630460672 00000100:00100000:2.0:1788791586.540840:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788791586.540847:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630460672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788791586.540860:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1788791586.540883:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ecb21, atime: 0x6a9ecb21, ctime: 0x6a9ecb21, blocks: 0xb 00010000:00010000:2.0:1788791586.540890:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090df8a76/0xcd6380150a323bfa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.540899:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1788791586.540902:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791586.540908:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090df8a76/0xcd6380150a323bfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.540921:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090df8a76/0xcd6380150a323bfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.540931:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090df8a76/0xcd6380150a323bfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.540938:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090df8a76/0xcd6380150a323bfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791586.540940:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00010000:00010000:2.0:1788791586.540954:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788791586.541521:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1875683630460672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 674us (761us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788791586.541529:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788791586.541545:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606360704 00000100:00100000:2.0:1788791586.541549:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606360704 00000100:00100000:2.0:1788791586.541566:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 67 00000100:00100000:2.0:1788791586.541573:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+13:2352:x1875683606360704:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1788791586.541616:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788791586.541629:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791586.541635:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090df8a76/0xcd6380150a323bfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.541644:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81ba00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791586.541649:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090df8a76/0xcd6380150a323bfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.541657:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090df8a76/0xcd6380150a323bfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.541673:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090df8a76/0xcd6380150a323bfa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.541681:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090df8a76/0xcd6380150a323bfa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.541698:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791586.541700:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791586.541709:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791586.543202:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1788791586.543214:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:3.0:1788791586.543234:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ababc135f80, transno 4294967307 00000004:00080000:3.0:1788791586.543246:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:3.0:1788791586.543261:0:3313:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9abab30e0a80 x1875683630460672/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788791602 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788791586.543274:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9abab30e0a80/2, rc 0, transno 4294967310 00000020:00080000:1.0:1788791586.543472:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:3.0:1788791586.543642:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab30e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630460672:0@lo:6:osp-syn-0-0.0 00000020:00080000:1.0:1788791586.543646:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788791586.555000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791586.555036:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606360832 00000100:00100000:1.0:1788791586.555044:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606360832 00010000:00010000:1.0:1788791586.555083:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a3239b5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675270 expref: 14 pid: 6683 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791586.555156:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:1.0:1788791586.555168:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:2354:x1875683606360832:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791586.555182:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791586.555188:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a3239b5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675270 expref: 14 pid: 6683 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.555204:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a3239b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675270 expref: 14 pid: 6683 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.555229:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788791586.555234:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788791586.555240:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.555257:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323bf3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791586.555289:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791586.555338:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+14:2354:x1875683606360832:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 172us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791586.555346:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 84 00010000:00010000:3.0:1788791586.559618:0:10087:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029b59112/0xcd6380150a3239b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675270 expref: 13 pid: 6683 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791586.559661:0:10087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10087:1875683630460544:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791586.559748:0:10087:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.563044:0:10087:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.563065:0:10087:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.563078:0:10087:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323bf3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.563095:0:10087:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.563122:0:10087:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791586.563720:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791586.563730:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.563740:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791586.563745:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.563753:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323bf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.563774:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323bf3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.563781:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323bf3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10087 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.563801:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791586.563803:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791586.563805:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791586.564859:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3315:x1875683630460416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24651us (24866us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788791586.564871:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:0.0:1788791586.565157:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9abab2d5bb80/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788791586.565179:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630460416:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788791586.603470:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788791586.603494:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630460800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791586.603561:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791586.605639:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630460800 00000100:00100000:1.0:1788791586.605654:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630460800 00000100:00100000:1.0:1788791586.605722:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788791586.605733:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875683630460800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788791586.605757:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3855613952 00000100:00100000:1.0:1788791586.605839:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875683630460800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791586.605846:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788791586.606499:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630460800:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788791586.617858:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:3.0:1788791586.617879:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1788791586.617888:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:0.0:1788791586.618700:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2352:x1875683606360704:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 77119us (77751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791586.618712:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 67 00000100:00100000:1.0:1788791586.623030:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791586.623170:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606361088 00000100:00100000:3.0:1788791586.623180:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606361088 00000100:00100000:3.0:1788791586.623238:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 228 00000100:00100000:3.0:1788791586.623248:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+20:11612:x1875683606361088:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788791586.623414:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791586.623442:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00200/0xcd6380150a323bde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675303 expref: 20 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.623463:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:3.0:1788791586.623467:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788791586.623495:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.623680:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.623693:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788791586.623927:0:5837:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000804dbfd2 reply state 00000000b4add7c3 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791586.623936:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788791586.624081:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+21:11612:x1875683606361088:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 834us (1060us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788791586.624098:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 228 00000100:00100000:1.0:1788791586.627902:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791586.628177:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606361216 00000100:00100000:2.0:1788791586.628187:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606361216 00000100:00100000:2.0:1788791586.628246:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:2.0:1788791586.628257:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2354:x1875683606361216:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788791586.628468:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788791586.628472:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788791585 00002000:00010000:2.0:1788791586.628475:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788791585 00002000:00010000:2.0:1788791586.628477:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788791586 -> 1788791585 00002000:00010000:2.0:1788791586.628479:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788791586.628566:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2354:x1875683606361216:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 310us (672us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788791586.628574:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 68 00010000:00010000:3.0:1788791586.632599:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.632633:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.632641:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.632647:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791586.632651:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.632722:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.632742:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:3.0:1788791586.632745:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791586.632750:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.632756:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791586.633004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791586.633080:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606361472 00000100:00100000:3.0:1788791586.633099:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606361472 00000100:00100000:0.0:1788791586.633496:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 229 00000100:00100000:0.0:1788791586.633509:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+20:11612:x1875683606361472:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788791586.633641:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323c08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.633655:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a323bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752f5 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.633735:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323c08 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.633769:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a323bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752f5 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.633791:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a323bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752f5 expref: 20 pid: 5839 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791586.633806:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630460928:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791586.633935:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbaaad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788791586.637112:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791586.637722:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606361600 00000100:00100000:3.0:1788791586.637732:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606361600 00010000:00010000:3.0:1788791586.637771:0:8452:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a323bc2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752f5 expref: 21 pid: 5839 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791586.637814:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:3.0:1788791586.637824:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+21:2354:x1875683606361600:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791586.637854:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791586.637862:0:8452:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a323bc2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752f5 expref: 21 pid: 5839 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.637875:0:8452:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a323bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752f5 expref: 21 pid: 5839 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.637895:0:8452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:3.0:1788791586.637900:0:8452:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323c08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.637910:0:8452:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323c08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.637916:0:8452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323c08 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.637933:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788791586.638153:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81aa00/0xcd6380150a323bc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752f5 expref: 21 pid: 5839 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791586.638171:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5836:1875683630460928:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791586.638192:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323c08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.638200:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323c08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.638205:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323c08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.638231:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323c08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.638238:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323c08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.638245:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323c08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.638250:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791586.638255:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323c08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.638262:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323c08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.638278:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:2.0:1788791586.638281:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788791586.638285:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323c08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.638291:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a323c08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791586.638542:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+20:2354:x1875683606361600:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 718us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791586.638551:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:2.0:1788791586.640448:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+19:11612:x1875683606361472:12345-192.168.201.29@tcp:55:lhsmtool_posix.0 Request processed in 6932us (7438us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788791586.640463:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 229 00000100:00100000:1.0:1788791586.642968:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791586.643098:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606361728 00000100:00100000:0.0:1788791586.643108:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606361728 00000100:00100000:0.0:1788791586.643289:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:0.0:1788791586.643301:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2353:x1875683606361728:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788791586.643345:0:12011:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323c0f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.643366:0:12011:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d5d2433/0xcd6380150a323bec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675311 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.643375:0:12011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788791586.643379:0:12011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788791586.643384:0:12011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323c0f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.643427:0:12011:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d5d2433/0xcd6380150a323bec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675311 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.643441:0:12011:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d5d2433/0xcd6380150a323bec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675311 expref: 8 pid: 6683 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791586.643475:0:12011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12011:1875683630461056:192.168.201.29@tcp:104: 00000100:00100000:0.0:1788791586.643677:0:12011:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbaaa300 going to sleep for 11 seconds 00000100:00100000:1.0:1788791586.646463:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791586.646681:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606361856 00000100:00100000:3.0:1788791586.646690:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606361856 00010000:00010000:3.0:1788791586.646728:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d5d2433/0xcd6380150a323bec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675311 expref: 9 pid: 6683 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791586.646769:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:3.0:1788791586.646778:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2355:x1875683606361856:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791586.646809:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791586.646830:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d5d2433/0xcd6380150a323bec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675311 expref: 9 pid: 6683 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.646843:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d5d2433/0xcd6380150a323bec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675311 expref: 9 pid: 6683 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.646868:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788791586.646872:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788791586.646878:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323c0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.646888:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323c0f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.646907:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791586.646955:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d51180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+9:2355:x1875683606361856:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 177us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791586.646963:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 86 00010000:00010000:0.0:1788791586.647312:0:12011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d5d2433/0xcd6380150a323bec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675311 expref: 8 pid: 6683 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791586.647327:0:12011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12011:1875683630461056:192.168.201.29@tcp:104: 00010000:00010000:0.0:1788791586.647348:0:12011:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323c0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.647357:0:12011:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323c0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.647363:0:12011:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323c0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.647386:0:12011:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323c0f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.647394:0:12011:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323c0f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.647401:0:12011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323c0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.647419:0:12011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fee00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791586.647424:0:12011:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323c0f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.647433:0:12011:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323c0f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.647444:0:12011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323c0f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.647450:0:12011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e09b4d0/0xcd6380150a323c0f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791586.647522:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2353:x1875683606361728:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 4217us (4558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791586.647530:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:1.0:1788791586.652293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791586.652368:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606362112 00000100:00100000:3.0:1788791586.652379:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606362112 00000100:00100000:3.0:1788791586.652451:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 230 00000100:00100000:3.0:1788791586.652463:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+19:11612:x1875683606362112:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788791586.652545:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.652564:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.652589:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.652959:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323c1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.652971:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323bd0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752fc expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.652980:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323c1d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.653014:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752fc expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.653028:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323bd0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752fc expref: 20 pid: 5839 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791586.653041:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d58000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875683630461184:192.168.201.29@tcp:104: 00000100:00100000:3.0:1788791586.653169:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab78daa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788791586.662098:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791586.662246:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d58000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875683630461184:192.168.201.29@tcp:104: 00010000:00010000:3.0:1788791586.662272:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323c1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791586.663003:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606362240 00000100:00100000:2.0:1788791586.663014:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606362240 00010000:00010000:2.0:1788791586.663054:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323bd0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752fc expref: 21 pid: 5839 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791586.663110:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:2.0:1788791586.663119:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa001d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+21:2355:x1875683606362240:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791586.663158:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791586.663166:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323bd0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752fc expref: 21 pid: 5839 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.663178:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323bd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752fc expref: 21 pid: 5839 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.663199:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323bd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752fc expref: 21 pid: 5839 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.663233:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:2.0:1788791586.663239:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323c1d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.663248:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323c1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.663255:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323c1d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.663291:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791586.663351:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa001d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+20:2355:x1875683606362240:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 233us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791586.663359:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 87 00010000:00010000:0.0:1788791586.663454:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323c1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.663462:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323c1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788791586.663672:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1788791586.663813:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1788791586.663857:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1788791586.663932:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5837:1875683630461312:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788791586.663985:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791586.664017:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbaaad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788791586.664123:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630461312 00000100:00100000:1.0:1788791586.664144:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630461312 00000100:00100000:1.0:1788791586.664177:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788791586.664185:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1875683630461312:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788791586.664257:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1875683630461312:12345-0@lo:1000:mdt00_001.0 Request processed in 74us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791586.664265:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788791586.664912:0:5837:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:2.0:1788791586.664918:0:5837:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:2.0:1788791586.664943:0:5837:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9abab2d5bb80 x1875683630460416/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788791602 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791586.664955:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5837:1875683630461312:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1788791586.665418:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788791586.665476:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab30e2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5837:1875683630461440:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788791586.665647:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791586.665743:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab2d7d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788791586.665816:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630461440 00000100:00100000:0.0:1788791586.665822:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630461440 00000100:00100000:0.0:1788791586.665853:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788791586.665861:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5837:x1875683630461440:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788791586.666033:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5837:x1875683630461440:12345-0@lo:1000:mdt00_001.0 Request processed in 172us (518us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788791586.666041:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788791586.666305:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab30e2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5837:1875683630461440:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1788791586.666335:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323c1d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.666357:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323c1d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.666363:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323c1d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.666369:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791586.666372:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323c1d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.666379:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323c1d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.666392:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9aba8533fd00) 00010000:00010000:2.0:1788791586.666395:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788791586.666399:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323c1d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.666405:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d000/0xcd6380150a323c1d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.666431:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.666436:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b60 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.666441:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.666445:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ffa00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791586.666454:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.666460:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b60 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.666468:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:2.0:1788791586.666470:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788791586.666476:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a400/0xcd6380150a323b67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752e0 expref: 23 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.666485:0:5837:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a400/0xcd6380150a323b67 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752e0 expref: 23 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.666494:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a400/0xcd6380150a323b67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752e0 expref: 23 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.666618:0:5837:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a400/0xcd6380150a323b67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752e0 expref: 23 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791586.666631:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab30e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875683630461568:192.168.201.29@tcp:105: 00000100:00100000:2.0:1788791586.666772:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab2d7d780 going to sleep for 11 seconds 00000100:00100000:2.0:1788791586.671818:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab30e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5837:1875683630461568:192.168.201.29@tcp:105: 00010000:00010000:2.0:1788791586.671856:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b60 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.671866:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a323b60 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.671919:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323c24 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.671933:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323c24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.671945:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323c24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.671954:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323c24 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.671960:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323c24 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.671967:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323c24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.671972:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81a600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791586.671975:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323c24 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.671982:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323c24 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.671992:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:2.0:1788791586.671995:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791586.671999:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323c24 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.672004:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323c24 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.672020:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.672025:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.672030:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.672035:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791586.672038:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.672042:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.672049:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:2.0:1788791586.672050:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788791586.672053:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.672058:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c400/0xcd6380150a323c16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791586.672316:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+23:11612:x1875683606362112:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 19855us (20031us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788791586.672326:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 230 00000020:00080000:2.0:1788791586.672331:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788791586.673169:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788791586.673175:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788791586.673467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791586.673544:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606362368 00000100:00100000:0.0:1788791586.673554:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606362368 00000100:00100000:0.0:1788791586.673607:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 61 00000100:00100000:0.0:1788791586.673617:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+23:11611:x1875683606362368:12345-192.168.201.29@tcp:49:lfs.0 00000100:00100000:0.0:1788791586.673739:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+23:11611:x1875683606362368:12345-192.168.201.29@tcp:49:lfs.0 Request processed in 123us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791586.673746:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 61 00000040:00080000:3.0:1788791586.675747:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788791586.675771:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788791586.676665:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791586.676761:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606362624 00000100:00100000:0.0:1788791586.676771:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606362624 00000100:00100000:0.0:1788791586.676860:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 62 00000100:00100000:0.0:1788791586.676871:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99283450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+23:11612:x1875683606362624:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788791586.678003:0:5840:0:(mdd_object.c:4131:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788791586.678116:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788791586.678259:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323c2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.678276:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323c2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.678299:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323c2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.678308:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323c2b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.678315:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323c2b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.678320:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323c2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791586.678379:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788791586.678487:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99283450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+25:11612:x1875683606362624:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 1616us (1824us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788791586.678497:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 62 00000020:00080000:0.0:1788791586.678502:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788791586.679900:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791586.680183:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606362880 00000100:00100000:1.0:1788791586.680193:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606362880 00000100:00100000:1.0:1788791586.680257:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 231 00000100:00100000:1.0:1788791586.680267:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+25:11611:x1875683606362880:12345-192.168.201.29@tcp:58:lfs.0 00000040:00080000:1.0:1788791586.680749:0:8351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788791586.680873:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+25:11611:x1875683606362880:12345-192.168.201.29@tcp:58:lfs.0 Request processed in 606us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791586.680882:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 231 00010000:00010000:2.0:1788791586.680978:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791586.680985:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323c2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.681006:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fee00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791586.681012:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323c2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.681021:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323c2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.681039:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9aba94530700) 00010000:00010000:2.0:1788791586.681042:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788791586.681048:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323c2b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.681054:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fee00/0xcd6380150a323c2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.681073:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791586.681075:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791586.681077:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791586.727072:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791586.727236:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606363008 00000100:00100000:2.0:1788791586.727246:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606363008 00000100:00100000:2.0:1788791586.727313:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 232 00000100:00100000:2.0:1788791586.727324:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+25:11614:x1875683606363008:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791586.727345:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791586.727365:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323c32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675318 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.727427:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323c39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.727457:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323c39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.727469:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323c39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.727484:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323c40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.727491:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.727499:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.731162:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323c47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.731187:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d9 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.731199:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323c47 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.731500:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d9 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.732541:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d9 expref: 26 pid: 5837 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791586.732586:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab30e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875683630461696:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788791586.732687:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab2d7d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791586.737282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791586.737295:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab30e3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875683630461696:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791586.737321:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323c47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791586.737465:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606363264 00000100:00100000:1.0:1788791586.737473:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606363264 00000100:00100000:1.0:1788791586.737534:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:1.0:1788791586.737544:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+27:5595:x1875683606363264:12345-192.168.201.29@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788791586.737876:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+28:5595:x1875683606363264:12345-192.168.201.29@tcp:35:ldlm_bl.0 Request processed in 332us (602us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1788791586.737885:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 63 00000100:00100000:0.0:1788791586.744325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791586.744477:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606363392 00000100:00100000:3.0:1788791586.744488:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606363392 00010000:00010000:3.0:1788791586.744533:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d9 expref: 28 pid: 5837 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791586.744576:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00100000:3.0:1788791586.744587:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+28:2355:x1875683606363392:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791586.744603:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791586.744609:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d9 expref: 28 pid: 5837 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.744622:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d9 expref: 28 pid: 5837 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.744644:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01c00/0xcd6380150a323b52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536752d9 expref: 28 pid: 5837 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.744660:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:3.0:1788791586.744666:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323c47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.744675:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.744682:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323c47 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791586.744740:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791586.744802:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+27:2355:x1875683606363392:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 215us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791586.744811:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 88 00010000:00010000:2.0:1788791586.745120:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745151:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791586.745193:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788791586.745198:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788791586.745218:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745243:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323c47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745253:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323c39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745259:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323c39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745266:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323c39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745272:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81ba00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791586.745283:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323c39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745291:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323c39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745301:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:2.0:1788791586.745304:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791586.745308:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323c39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745314:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ba00/0xcd6380150a323c39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745326:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323c40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745332:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323c40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745338:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323c40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745343:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791586.745346:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323c40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745351:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323c40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745358:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9aba8533fd00) 00010000:00010000:2.0:1788791586.745361:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791586.745372:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323c40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745379:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a323c40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745414:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a323c32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675318 expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745429:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323c47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675318 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791586.745437:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:2.0:1788791586.745439:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788791586.745442:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81b800, rc 0) 00000100:00100000:2.0:1788791586.745487:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+26:11614:x1875683606363008:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 18166us (18427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791586.745495:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 232 00000040:00080000:2.0:1788791587.416809:0:12507:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788791587.416819:0:12507:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788791587.416878:0:12507:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788791587.416884:0:12507:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788791587.491433:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788791587.683373:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788791587.683383:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788791587.683437:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788791587.683444:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788791587.683570:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab30e3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875683630461824:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788791587.683684:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab2d7da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788791587.690987:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab30e3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875683630461824:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788791587.692106:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791587.692273:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606363520 00000100:00100000:3.0:1788791587.692282:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606363520 00000100:00100000:3.0:1788791587.692350:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 233 00000100:00100000:3.0:1788791587.692361:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+26:11627:x1875683606363520:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788791587.692393:0:5836:0:(mdt_handler.c:8010:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788791587.692481:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+26:11627:x1875683606363520:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 122us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791587.692488:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 233 00000100:00080000:2.0:1788791587.692643:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791587.715560:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791587.719171:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606363776 00000100:00100000:2.0:1788791587.719188:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606363776 00000100:00100000:2.0:1788791587.719332:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 234 00000100:00100000:2.0:1788791587.719345:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+26:11627:x1875683606363776:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788791587.719368:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791587.719388:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a000/0xcd6380150a323c4e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367531f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791587.719487:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323c55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791587.719501:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791587.719515:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323c55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791587.719526:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788791587.719649:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a000/0xcd6380150a323c4e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367531f expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791587.719668:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323c55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367531f expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791587.719677:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:2.0:1788791587.719680:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788791587.719684:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81bc00, rc 0) 00000100:00100000:2.0:1788791587.719758:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+28:11627:x1875683606363776:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 416us (4210us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788791587.719794:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 234 00000100:00100000:0.0:1788791587.736837:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791587.736880:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791587.736940:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606364160 00000100:00100000:2.0:1788791587.736949:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606364160 00000100:00100000:2.0:1788791587.737021:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:2.0:1788791587.737033:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+28:2353:x1875683606364160:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791587.737049:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791587.737083:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81bc00/0xcd6380150a323c55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367531f expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791587.737102:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:2.0:1788791587.737107:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791587.737193:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+27:2353:x1875683606364160:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 162us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791587.737201:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:3.0:1788791587.737745:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606364032 00000100:00100000:3.0:1788791587.737751:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606364032 00000100:00100000:3.0:1788791587.737803:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 235 00000100:00100000:3.0:1788791587.737811:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+27:11627:x1875683606364032:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788791587.737877:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791587.737892:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791587.737902:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791587.738103:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791587.738154:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791587.738162:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791587.738167:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c800 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791587.738172:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791587.738180:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791587.738190:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:3.0:1788791587.738193:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788791587.738197:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791587.738202:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791587.738338:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+28:11627:x1875683606364032:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 527us (1509us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788791587.738347:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 235 00000040:00080000:2.0:1788791587.738773:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788791587.738939:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788791587.739451:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788791587.739459:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788791587.747596:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791587.747680:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606364416 00000100:00100000:1.0:1788791587.747691:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606364416 00000100:00100000:1.0:1788791587.747747:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 64 00000100:00100000:1.0:1788791587.747758:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+28:11627:x1875683606364416:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788791587.748039:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+29:11627:x1875683606364416:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 282us (452us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788791587.748060:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 64 00010000:00010000:2.0:1788791588.515429:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788791589.409811:0:12559:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788791589.409822:0:12559:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788791589.409870:0:12559:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788791589.409883:0:12559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788791589.432605:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791589.432654:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791589.432694:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791589.432732:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791589.432764:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606364544 00000100:00100000:3.0:1788791589.432773:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606364544 00000100:00100000:3.0:1788791589.432823:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 298 00000100:00100000:3.0:1788791589.432834:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2352:x1875683606364544:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791589.432905:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2352:x1875683606364544:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 73us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791589.432913:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 298 00000100:00100000:3.0:1788791589.432948:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606364800 00000100:00100000:3.0:1788791589.432953:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606364800 00000100:00100000:3.0:1788791589.432998:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:3.0:1788791589.433006:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2352:x1875683606364800:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791589.433049:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2352:x1875683606364800:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 43us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791589.433057:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:3.0:1788791589.433083:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606364672 00000100:00100000:3.0:1788791589.433087:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606364672 00000100:00100000:3.0:1788791589.433123:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606365056 00000100:00080000:2.0:1788791589.433123:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788791589.433151:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788791589.433152:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606365056 00000100:00100000:2.0:1788791589.433181:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 153 00000100:00100000:3.0:1788791589.433195:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 154 00000100:00100000:2.0:1788791589.433196:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+29:2353:x1875683606364672:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791589.433209:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28665881-f918-4421-b36a-72ee58aec27e+5:2352:x1875683606365056:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791589.433232:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+29:2353:x1875683606364672:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 44us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791589.433237:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 153 00000100:00100000:3.0:1788791589.433248:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28665881-f918-4421-b36a-72ee58aec27e+5:2352:x1875683606365056:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 40us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791589.433256:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 154 00000100:00080000:2.0:1788791589.433265:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791589.436457:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791589.436527:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606364928 00000100:00100000:2.0:1788791589.436536:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606364928 00000100:00100000:2.0:1788791589.436625:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:2.0:1788791589.436648:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2353:x1875683606364928:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791589.436715:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2353:x1875683606364928:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 70us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791589.436723:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00080000:0.0:1788791589.436931:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788791589.541451:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791589.606917:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791589.611960:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606365312 00000100:00100000:3.0:1788791589.611975:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606365312 00000100:00100000:3.0:1788791589.616423:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 236 00000100:00100000:3.0:1788791589.616448:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+29:11647:x1875683606365312:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:3.0:1788791589.616470:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791589.616490:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675326 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791589.616585:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323c71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791589.616599:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323c71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791589.616610:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323c71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791589.616622:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788791589.616738:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675326 expref: 32 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791589.616759:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323c71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675326 expref: 31 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791589.616767:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:3.0:1788791589.616770:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788791589.616773:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16de00, rc 0) 00000100:00100000:3.0:1788791589.617093:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+31:11647:x1875683606365312:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 655us (10185us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788791589.617116:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 236 00000100:00100000:1.0:1788791589.625237:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791589.625365:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606365440 00000100:00100000:2.0:1788791589.625375:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606365440 00000100:00100000:2.0:1788791589.625422:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 237 00000100:00100000:2.0:1788791589.625433:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+31:11647:x1875683606365440:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:2.0:1788791589.625498:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323c7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791589.625514:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791589.625527:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791589.625553:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791589.625560:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323c7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791589.625568:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323c7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791589.625586:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81ae00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791589.625591:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323c7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791589.625599:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323c7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791589.625612:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:2.0:1788791589.625616:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788791589.625620:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323c7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791589.625627:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a323c7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791589.625692:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+31:11647:x1875683606365440:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 260us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791589.625700:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 237 00000100:00100000:3.0:1788791589.733428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791589.733924:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606365568 00000100:00100000:0.0:1788791589.733935:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606365568 00000100:00100000:0.0:1788791589.733998:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:0.0:1788791589.734009:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2355:x1875683606365568:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:0.0:1788791589.734071:0:12011:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791589.734092:0:12011:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a323c86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367532d expref: -99 pid: 12011 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788791589.734118:0:12011:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9ecb21, atime: 0x6a9ecb21, ctime: 0x6a9ecb21, blocks: 0xb 00010000:00010000:0.0:1788791589.734173:0:12011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1788791589.734179:0:12011:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791589.734196:0:12011:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a323c86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367532d expref: 8 pid: 12011 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791589.734219:0:12011:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a323c86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367532d expref: 8 pid: 12011 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791589.734233:0:12011:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe400, rc 0) 00000100:00100000:2.0:1788791589.734386:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2355:x1875683606365568:12345-192.168.201.29@tcp:101:cat.0 Request processed in 378us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791589.734394:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 70 00000100:00100000:2.0:1788791589.740011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791589.740170:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606365696 00000100:00100000:3.0:1788791589.740179:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606365696 00002000:00100000:3.0:1788791589.740229:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9abab30e1c00 x1875683606365696/t0(0) o3->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:300/0 lens 488/0 e 0 to 0 dl 1788791600 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788791589.740240:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9abab30e1c00 with x1875683606365696 ext(0->4095) 00002000:00010000:3.0:1788791589.740245:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9abab30e1c00 00000100:00100000:3.0:1788791589.740275:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1788791589.740284:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2354:x1875683606365696:12345-192.168.201.29@tcp:3:cat.0 00000100:00100000:3.0:1788791589.740481:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+8:2354:x1875683606365696:12345-192.168.201.29@tcp:3:cat.0 Request processed in 197us (479us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788791589.740488:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00002000:00100000:3.0:1788791589.740494:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9abab30e1c00 x1875683606365696/t0(0) o3->aafa64f5-7c0a-45ff-aeda-f3a6deb3b804@192.168.201.29@tcp:300/0 lens 488/4536 e 0 to 0 dl 1788791600 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788791589.740502:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9abab30e1c00 with x1875683606365696 ext(0->4095) 00002000:00010000:3.0:1788791589.740505:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9abab30e1c00 00010000:00010000:1.0:1788791590.567451:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788791591.204185:0:7980:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367584054883ns, next at 368584052234ns, rc = 0 00000100:00100000:2.0:1788791591.204229:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab30e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630461952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791591.204296:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791591.204565:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630461952 00000100:00100000:2.0:1788791591.204575:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630461952 00000100:00100000:2.0:1788791591.204702:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788791591.204722:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875683630461952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788791591.204755:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791591.204800:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875683630461952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791591.204808:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788791591.204829:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788791591.204864:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab30e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630461952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791591.212247:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788791591.212268:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630462080:0@lo:400:kworker.0 00000100:00100000:3.0:1788791591.212340:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791591.212386:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630462080 00000100:00100000:3.0:1788791591.212394:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630462080 00000100:00100000:3.0:1788791591.212452:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788791591.212463:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba863e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630462080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791591.212520:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba863e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630462080:12345-0@lo:400:kworker.0 Request processed in 59us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791591.212528:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788791591.212570:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630462080:0@lo:400:kworker.0 00000100:00100000:3.0:1788791591.214980:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630462208:0@lo:400:kworker.0 00000100:00100000:3.0:1788791591.215050:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791591.215098:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630462208 00000100:00100000:3.0:1788791591.215104:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630462208 00000100:00100000:3.0:1788791591.215161:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788791591.215171:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630462208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791591.215218:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630462208:12345-0@lo:400:kworker.0 Request processed in 48us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791591.215225:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788791591.215262:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630462208:0@lo:400:kworker.0 00000100:00100000:3.0:1788791591.215292:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630462336:0@lo:400:kworker.0 00000100:00100000:3.0:1788791591.216418:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791591.216537:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630462464:0@lo:400:kworker.0 00000100:00100000:3.0:1788791591.216573:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791591.216843:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630462336 00000100:00100000:1.0:1788791591.216850:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630462336 00000100:00100000:1.0:1788791591.216894:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788791591.216901:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630462336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791591.216945:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630462336:12345-0@lo:400:kworker.0 Request processed in 45us (1628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791591.216952:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788791591.217734:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb911c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630462336:0@lo:400:kworker.0 00000100:00100000:2.0:1788791591.219566:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630462592:0@lo:400:kworker.0 00000100:00100000:2.0:1788791591.220081:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788791591.220215:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791591.220249:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630462592 00000100:00100000:2.0:1788791591.220256:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630462592 00000100:00100000:2.0:1788791591.220305:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788791591.220314:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630462592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791591.220447:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630462592:12345-0@lo:400:kworker.0 Request processed in 134us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791591.220455:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:2.0:1788791591.220474:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791591.220500:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630462592:0@lo:400:kworker.0 00000100:00100000:0.0:1788791591.221429:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630462464 00000100:00100000:0.0:1788791591.221437:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630462464 00000100:00100000:0.0:1788791591.221483:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788791591.221492:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875683630462464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791591.221550:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875683630462464:12345-0@lo:400:kworker.0 Request processed in 59us (4975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791591.221556:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788791591.221886:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630462464:0@lo:400:kworker.0 00000100:00080000:1.0:1788791591.222272:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788791591.296071:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:3.0:1788791591.588191:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791591.715377:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788791591.715406:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630462720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788791591.715478:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791591.715589:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630462720 00000100:00100000:0.0:1788791591.715597:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630462720 00000100:00100000:0.0:1788791591.715654:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788791591.715664:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630462720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788791591.715707:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791591.715766:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630462720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791591.715775:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788791591.715812:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788791591.715818:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9abab30e0a80, transno 4294967310 00000100:00100000:0.0:1788791591.715835:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630462720:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788791591.774489:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000001:00080000:0.0:1788791591.774511:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:0.0:1788791591.774521:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000004:00080000:0.0:1788791591.774534:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:0.0:1788791591.774554:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9abab2d7d600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788791591.774560:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9aba87c8a500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9abab2d7d6c0 00000020:00080000:0.0:1788791591.774563:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9aba87c8ad00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9ababba98800 00000001:00080000:0.0:1788791591.774582:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1788791591.774602:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788791591.774774:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1788791591.774845:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb6d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630462848:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788791591.774912:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791591.774985:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630462848 00000100:00100000:0.0:1788791591.774992:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630462848 00000100:00100000:0.0:1788791591.775047:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788791591.775058:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb6d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1875683630462848:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788791591.775268:0:10087:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788791591.775273:0:10087:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788791585 -> 1788791585 00002000:00010000:0.0:1788791591.775275:0:10087:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1788791585 -> 1788791585 00002000:00010000:0.0:1788791591.775278:0:10087:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788791585 -> 1788791585 00002000:00010000:0.0:1788791591.775304:0:10087:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788791591.775344:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb6d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3313:x1875683630462848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 288us (432us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788791591.775352:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00080000:0.0:1788791591.775398:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9ababb6d4a80/2, rc 0, transno 4294967324 00000100:00100000:0.0:1788791591.775404:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb6d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630462848:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1788791591.788582:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1788791591.788598:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00010000:00010000:3.0:1788791592.619564:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791593.635448:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791594.415085:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791594.417929:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606365824 00000100:00100000:2.0:1788791594.417956:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606365824 00000100:00100000:3.0:1788791594.418172:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 238 00000100:00100000:3.0:1788791594.418186:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:11300:x1875683606365824:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 00000100:00080000:1.0:1788791594.418534:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791594.418791:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:11300:x1875683606365824:12345-192.168.201.29@tcp:60:lhsmtool_posix.0 Request processed in 606us (3713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791594.418799:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 238 00000100:00100000:0.0:1788791594.423231:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791594.426168:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606366080 00000100:00100000:3.0:1788791594.426183:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606366080 00000100:00100000:3.0:1788791594.426241:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:3.0:1788791594.426252:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:11300:x1875683606366080:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788791594.428162:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+19:11300:x1875683606366080:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 1904us (4932us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788791594.428176:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 65 00000100:00100000:2.0:1788791594.546731:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791594.546783:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791594.546964:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606366464 00000100:00100000:3.0:1788791594.546975:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606366464 00000100:00100000:1.0:1788791594.547119:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606366208 00000100:00080000:2.0:1788791594.547120:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788791594.547228:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606366208 00000100:00100000:1.0:1788791594.547311:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 300 00000100:00100000:1.0:1788791594.547323:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2353:x1875683606366208:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791594.547349:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:2.0:1788791594.547358:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2353:x1875683606366464:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791594.547395:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2353:x1875683606366464:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 38us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791594.547395:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2353:x1875683606366208:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 74us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791594.547404:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:1.0:1788791594.547404:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 300 00000100:00100000:1.0:1788791594.551773:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791594.551812:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791594.551848:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606366336 00000100:00100000:2.0:1788791594.551857:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606366336 00000100:00100000:3.0:1788791594.551923:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606366592 00000100:00100000:3.0:1788791594.551928:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606366592 00000100:00100000:3.0:1788791594.551991:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 158 00000100:00100000:2.0:1788791594.551991:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:3.0:1788791594.552002:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28665881-f918-4421-b36a-72ee58aec27e+5:2352:x1875683606366592:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791594.552002:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2352:x1875683606366336:12345-192.168.201.29@tcp:400:kworker.0 00000100:00080000:1.0:1788791594.552070:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791594.552072:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2352:x1875683606366336:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 72us (306us total) trans 0 rc 0/0 00000100:00080000:1.0:1788791594.552075:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791594.552079:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:3.0:1788791594.552274:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:28665881-f918-4421-b36a-72ee58aec27e+5:2352:x1875683606366592:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 274us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791594.552282:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 158 00010000:00010000:3.0:1788791594.659287:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791594.703724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791594.703901:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606366720 00000100:00100000:3.0:1788791594.703912:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606366720 00000100:00100000:3.0:1788791594.703980:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 239 00000100:00100000:3.0:1788791594.703991:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28665881-f918-4421-b36a-72ee58aec27e+5:12099:x1875683606366720:12345-192.168.201.29@tcp:101:lsof.0 00010000:00010000:3.0:1788791594.704019:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791594.704040:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323c8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675334 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791594.704102:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791594.704115:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791594.704153:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788791594.704362:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1788791594.704366:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788791594.704443:0:5839:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791594.704469:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ce00/0xcd6380150a323c8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675334 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791594.704487:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675334 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791594.704496:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ababb052300) 00010000:00010000:3.0:1788791594.704499:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788791594.704503:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c800, rc 0) 00000100:00100000:3.0:1788791594.704567:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:28665881-f918-4421-b36a-72ee58aec27e+6:12099:x1875683606366720:12345-192.168.201.29@tcp:101:lsof.0 Request processed in 578us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791594.704574:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 239 00000040:00080000:0.0:1788791594.916446:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788791594.916455:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788791594.916753:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788791594.916761:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788791595.683901:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791596.324159:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab30e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630462976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791596.324241:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791596.324299:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630462976 00000100:00100000:0.0:1788791596.324307:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630462976 00000100:00080000:1.0:1788791596.324345:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788791596.324361:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788791596.324373:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875683630462976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788791596.324406:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791596.324457:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875683630462976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791596.324464:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788791596.324503:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1788791596.324509:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9abab2d5bb80, transno 4294967321 00000004:00080000:1.0:1788791596.324528:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:1.0:1788791596.324553:0:3314:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9ababb6d4a80 x1875683630462848/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788791607 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791596.324571:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab30e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630462976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791596.325116:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630463104:0@lo:400:kworker.0 00000100:00100000:2.0:1788791596.325242:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630463488:0@lo:400:kworker.0 00000100:00100000:2.0:1788791596.325318:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791596.325455:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630463360:0@lo:400:kworker.0 00000100:00100000:3.0:1788791596.325528:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791596.325565:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630463616:0@lo:400:kworker.0 00000100:00100000:3.0:1788791596.325597:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791596.325638:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630463104 00000100:00100000:3.0:1788791596.325642:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630463104 00000100:00100000:3.0:1788791596.325677:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788791596.325685:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3315:x1875683630463104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791596.325724:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3315:x1875683630463104:12345-0@lo:400:kworker.0 Request processed in 41us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791596.325729:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788791596.325760:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630463616 00000100:00100000:3.0:1788791596.325764:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630463616 00000100:00100000:0.0:1788791596.325791:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630463488 00000100:00100000:0.0:1788791596.325798:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630463488 00000100:00100000:3.0:1788791596.325801:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1788791596.325808:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791596.325814:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630463616:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788791596.325816:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788791596.325854:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875683630463616:12345-0@lo:400:kworker.0 Request processed in 43us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791596.325858:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788791596.325866:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788791596.325872:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630463488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791596.325896:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630463104:0@lo:400:kworker.0 00000100:00100000:3.0:1788791596.325903:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630463616:0@lo:400:kworker.0 00000100:00100000:3.0:1788791596.325999:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630463232:0@lo:400:kworker.0 00000100:00100000:3.0:1788791596.326022:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791596.326059:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630463232 00000100:00100000:3.0:1788791596.326063:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630463232 00000100:00100000:0.0:1788791596.326071:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630463488:12345-0@lo:400:kworker.0 Request processed in 201us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791596.326079:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788791596.326100:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788791596.326107:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630463232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791596.326154:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630463488:0@lo:400:kworker.0 00000100:00100000:2.0:1788791596.327017:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791596.327057:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630463360 00000100:00100000:2.0:1788791596.327061:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630463360 00000100:00100000:2.0:1788791596.327103:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788791596.327112:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630463360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791596.327166:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630463360:12345-0@lo:400:kworker.0 Request processed in 55us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791596.327173:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:2.0:1788791596.327190:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791596.327220:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630463360:0@lo:400:kworker.0 00000100:00100000:3.0:1788791596.329087:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630463232:12345-0@lo:400:kworker.0 Request processed in 2973us (3055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791596.329100:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788791596.329111:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630463232:0@lo:400:kworker.0 00010000:00010000:3.0:1788791596.707298:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791596.836647:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630463744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791596.836720:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791596.837469:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630463744 00000100:00100000:3.0:1788791596.837478:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630463744 00000100:00100000:3.0:1788791596.837539:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788791596.837549:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630463744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788791596.837581:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791596.837628:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630463744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791596.837635:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788791596.840366:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630463744:0@lo:13:osp-pre-0-0.0 00000020:00080000:0.0:1788791596.904688:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1788791596.904711:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788791596.904723:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788791596.904732:0:5870:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:3.0:1788791596.905700:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:3.0:1788791597.731745:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788791598.281266:0:12761:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 10:33:16 (1788791596) 00010000:00010000:3.0:1788791598.756337:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791599.663351:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791599.663415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791599.663521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791599.663543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791599.663567:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791599.663606:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606367232 00000100:00100000:2.0:1788791599.663615:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606367232 00000100:00100000:2.0:1788791599.663661:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606367104 00000100:00100000:2.0:1788791599.663664:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606367104 00000100:00100000:2.0:1788791599.663684:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:2.0:1788791599.663693:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2354:x1875683606367232:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791599.663759:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2354:x1875683606367232:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 66us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791599.663766:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 71 00000100:00100000:2.0:1788791599.663782:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:2.0:1788791599.663788:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2354:x1875683606367104:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791599.663810:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2354:x1875683606367104:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 23us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791599.663815:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:2.0:1788791599.663831:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606366848 00000100:00100000:2.0:1788791599.663835:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606366848 00000100:00100000:2.0:1788791599.664013:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 302 00000100:00100000:2.0:1788791599.664022:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2354:x1875683606366848:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:2.0:1788791599.664049:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2354:x1875683606366848:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 29us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791599.664065:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 302 00000100:00100000:2.0:1788791599.664099:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606366976 00000100:00100000:2.0:1788791599.664103:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606366976 00000100:00100000:2.0:1788791599.664344:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606367360 00000100:00100000:2.0:1788791599.664348:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606367360 00000100:00100000:3.0:1788791599.666878:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 162 00000100:00100000:3.0:1788791599.666899:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab30e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:2354:x1875683606366976:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791599.666978:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab30e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:2354:x1875683606366976:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 86us (5548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791599.666986:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 162 00000100:00100000:3.0:1788791599.667008:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 163 00000100:00100000:3.0:1788791599.667014:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28665881-f918-4421-b36a-72ee58aec27e+6:2354:x1875683606367360:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791599.667052:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb703100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28665881-f918-4421-b36a-72ee58aec27e+6:2354:x1875683606367360:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 36us (3482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791599.667059:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 163 00000100:00080000:2.0:1788791599.667346:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788791599.667354:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788791599.667357:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788791599.781795:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791600.803291:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791601.444982:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630463872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791601.445068:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791601.445121:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630464384:0@lo:400:kworker.0 00000100:00100000:1.0:1788791601.445179:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791601.445205:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788791601.445212:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630464256:0@lo:400:kworker.0 00000100:00100000:1.0:1788791601.445237:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791601.445382:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630464000:0@lo:400:kworker.0 00000100:00100000:2.0:1788791601.445416:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791601.445444:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630464512:0@lo:400:kworker.0 00000100:00100000:2.0:1788791601.445464:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791601.445484:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788791601.445489:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630464128:0@lo:400:kworker.0 00000100:00100000:2.0:1788791601.445511:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791601.445526:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630464640:0@lo:400:kworker.0 00000100:00100000:2.0:1788791601.445564:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791601.445594:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630464256 00000100:00100000:2.0:1788791601.445602:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630464256 00000100:00100000:2.0:1788791601.445649:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630464512 00000100:00100000:2.0:1788791601.445652:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630464512 00000100:00100000:2.0:1788791601.445666:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630464128 00000100:00100000:2.0:1788791601.445668:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630464128 00000100:00100000:2.0:1788791601.445680:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788791601.445688:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630464256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791601.445738:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630464256:12345-0@lo:400:kworker.0 Request processed in 51us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791601.445754:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788791601.445771:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788791601.445776:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630464512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791601.445805:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630464512:12345-0@lo:400:kworker.0 Request processed in 29us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791601.445810:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788791601.445821:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788791601.445838:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630464128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791601.445865:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630464128:12345-0@lo:400:kworker.0 Request processed in 39us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791601.445870:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788791601.445891:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630464384 00000100:00100000:2.0:1788791601.445895:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630464384 00000100:00100000:2.0:1788791601.445919:0:12011:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630464640 00000100:00100000:2.0:1788791601.445922:0:12011:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630464640 00000100:00100000:2.0:1788791601.445941:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788791601.445947:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630464384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791601.445977:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630464384:12345-0@lo:400:kworker.0 Request processed in 31us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791601.445982:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788791601.445991:0:12011:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788791601.445997:0:12011:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630464640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791601.446017:0:12011:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630464640:12345-0@lo:400:kworker.0 Request processed in 21us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791601.446033:0:12011:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788791601.446054:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788791601.446057:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788791601.446060:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791601.446092:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630464128:0@lo:400:kworker.0 00000100:00100000:2.0:1788791601.446101:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788791601.446106:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9ababb6d4a80, transno 4294967324 00000100:00100000:2.0:1788791601.446114:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630464640:0@lo:400:kworker.0 00000100:00100000:2.0:1788791601.446123:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630464512:0@lo:400:kworker.0 00000100:00100000:2.0:1788791601.446218:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630464256:0@lo:400:kworker.0 00000100:00100000:2.0:1788791601.446228:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630464384:0@lo:400:kworker.0 00000100:00100000:3.0:1788791601.446491:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630463872 00000100:00100000:3.0:1788791601.446496:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630463872 00000100:00100000:3.0:1788791601.446535:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788791601.446543:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630463872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788791601.446573:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791601.446631:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630463872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791601.446636:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788791601.446681:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630463872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791601.447601:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630464000 00000100:00100000:1.0:1788791601.447610:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630464000 00000100:00100000:1.0:1788791601.447661:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788791601.447669:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630464000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791601.447720:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630464000:12345-0@lo:400:kworker.0 Request processed in 52us (2303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791601.447727:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788791601.447857:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630464000:0@lo:400:kworker.0 00010000:00010000:3.0:1788791601.827529:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791601.956401:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630464768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791601.956603:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791601.956713:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630464768 00000100:00100000:0.0:1788791601.956721:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630464768 00000100:00100000:0.0:1788791601.956769:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788791601.956778:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630464768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788791601.956811:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791601.956862:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630464768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791601.956869:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788791601.956915:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630464768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791602.386210:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791602.386366:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606367616 00000100:00100000:3.0:1788791602.386376:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606367616 00000100:00100000:3.0:1788791602.386458:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00100000:3.0:1788791602.386469:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+18:12321:x1875683606367616:12345-192.168.201.29@tcp:35:umount.0 00000100:00100000:3.0:1788791602.387013:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+19:12321:x1875683606367616:12345-192.168.201.29@tcp:35:umount.0 Request processed in 544us (811us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788791602.387023:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 66 00000100:00080000:2.0:1788791602.387531:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791602.390287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791602.390595:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606367872 00000100:00100000:3.0:1788791602.390606:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606367872 00000100:00100000:3.0:1788791602.390665:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 67 00000100:00100000:3.0:1788791602.390676:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+19:12321:x1875683606367872:12345-192.168.201.29@tcp:35:umount.0 00000100:00100000:3.0:1788791602.391026:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+20:12321:x1875683606367872:12345-192.168.201.29@tcp:35:umount.0 Request processed in 351us (746us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788791602.391034:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 67 00000100:00100000:3.0:1788791602.397474:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791602.397656:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606368128 00000100:00100000:1.0:1788791602.397666:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606368128 00000100:00100000:1.0:1788791602.397720:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:1.0:1788791602.397728:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99280450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+20:12321:x1875683606368128:12345-192.168.201.29@tcp:35:umount.0 00000100:00100000:1.0:1788791602.398158:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99280450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+21:12321:x1875683606368128:12345-192.168.201.29@tcp:35:umount.0 Request processed in 428us (693us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788791602.398166:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 68 00000100:00100000:2.0:1788791602.402939:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791602.403006:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606368384 00000100:00100000:3.0:1788791602.403017:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606368384 00000100:00100000:3.0:1788791602.403078:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:3.0:1788791602.403089:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+21:12321:x1875683606368384:12345-192.168.201.29@tcp:35:umount.0 00000100:00100000:3.0:1788791602.403478:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb041500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+22:12321:x1875683606368384:12345-192.168.201.29@tcp:35:umount.0 Request processed in 390us (548us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788791602.403486:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 69 00000100:00100000:2.0:1788791602.406005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791602.406044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791602.406080:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791602.406176:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606368640 00000100:00100000:0.0:1788791602.406185:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606368640 00000100:00100000:1.0:1788791602.406216:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606368512 00000100:00100000:1.0:1788791602.406223:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606368512 00000100:00100000:0.0:1788791602.406249:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606368768 00000100:00100000:0.0:1788791602.406254:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606368768 00000100:00100000:1.0:1788791602.406260:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:1.0:1788791602.406273:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb040e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+15:2352:x1875683606368640:12345-192.168.201.29@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788791602.406281:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00010000:00010000:1.0:1788791602.406289:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788791602.406291:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+15:2352:x1875683606368512:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791602.406312:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abaa1b5d200/0xcd6380150a322c72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674e87 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791602.406316:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791602.406332:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788791602.406332:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abac2170a00/0xcd6380150a322d0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ebf expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791602.406346:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791602.406398:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb040e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+13:2352:x1875683606368640:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 127us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791602.406406:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:3.0:1788791602.406421:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:1.0:1788791602.406427:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788791602.406433:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb040700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:2352:x1875683606368768:12345-192.168.201.29@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788791602.406436:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:3.0:1788791602.406447:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791602.406459:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abac2170600/0xcd6380150a322f20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f8a expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791602.406469:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791602.406872:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:2352:x1875683606368512:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 582us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791602.406880:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:3.0:1788791602.406995:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb040700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2352:x1875683606368768:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 564us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791602.407002:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:0.0:1788791602.410292:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791602.410444:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606369152 00000100:00100000:1.0:1788791602.410454:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606369152 00000100:00100000:1.0:1788791602.410535:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 72 00000100:00100000:1.0:1788791602.410547:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+7:2351:x1875683606369152:12345-192.168.201.29@tcp:9:umount.0 00000020:00000080:1.0:1788791602.410575:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a323245 00000020:00010000:1.0:1788791602.410582:0:6683:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9aba867b2000: total 0 00000100:00080000:1.0:1788791602.410597:0:6683:0:(import.c:65:import_set_state_nolock()) ffff9aba867b7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788791602.410653:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788791602.410911:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2351:x1875683606369152:12345-192.168.201.29@tcp:9:umount.0 Request processed in 365us (625us total) trans 0 rc 0/0 00000020:00010000:3.0:1788791602.410919:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9aba867b2000: total 0 00000100:00100000:1.0:1788791602.410920:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 72 00010000:00010000:3.0:1788791602.410954:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9aba867b2000, canceled 0 locks, left on hash table 2. 00000100:00080000:1.0:1788791602.410957:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788791602.411001:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2b492e6/0xcd6380150a323c86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367532d expref: 4 pid: 12011 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791602.411047:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f03f07c/0xcd6380150a3235e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367515f expref: 3 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791602.411060:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9aba867b2000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788791602.411072:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791602.411074:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791602.411076:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791602.416101:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791602.416239:0:10087:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606369280 00000100:00100000:0.0:1788791602.416250:0:10087:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606369280 00000100:00100000:0.0:1788791602.416313:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 73 00000100:00100000:0.0:1788791602.416324:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+5:2351:x1875683606369280:12345-192.168.201.29@tcp:9:umount.0 00000020:00000080:0.0:1788791602.416353:0:10087:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322fe4 00000100:00080000:0.0:1788791602.416363:0:10087:0:(import.c:65:import_set_state_nolock()) ffff9abab7a72000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788791602.416403:0:10087:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788791602.416670:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+2:2351:x1875683606369280:12345-192.168.201.29@tcp:9:umount.0 Request processed in 346us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791602.416678:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 73 00010000:00010000:3.0:1788791602.416974:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788791602.417585:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791602.429776:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791602.429913:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606370304 00000100:00100000:0.0:1788791602.429923:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606370304 00000100:00100000:0.0:1788791602.430124:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 240 00000100:00100000:0.0:1788791602.430193:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+22:2351:x1875683606370304:12345-192.168.201.29@tcp:39:umount.0 00000020:00000080:0.0:1788791602.430229:0:5836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322c80 00000020:00010000:0.0:1788791602.430246:0:5836:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9abab306a000: total 0 00000100:00080000:0.0:1788791602.430250:0:5836:0:(import.c:65:import_set_state_nolock()) ffff9abab306b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788791602.430281:0:5836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1788791602.430972:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:aafa64f5-7c0a-45ff-aeda-f3a6deb3b804+21:2351:x1875683606370304:12345-192.168.201.29@tcp:39:umount.0 Request processed in 780us (1206us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788791602.430981:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 240 00000020:00010000:2.0:1788791602.431366:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9abab306a000: total 0 00010000:00010000:2.0:1788791602.431371:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791602.431411:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9abab306a000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788791602.431444:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:2.0:1788791602.431447:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788791602.431455:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00400/0xcd6380150a3235d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675158 expref: 21 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791602.431491:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:2.0:1788791602.431494:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788791602.431498:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b800/0xcd6380150a323c47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675318 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791602.431511:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:2.0:1788791602.431513:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788791602.431517:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16de00/0xcd6380150a323c71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675326 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791602.431527:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:2.0:1788791602.431530:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788791602.431533:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3235a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367514a expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791602.431545:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:2.0:1788791602.431547:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788791602.431552:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b000/0xcd6380150a323945 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675254 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791602.431564:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:2.0:1788791602.431565:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788791602.431570:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe200/0xcd6380150a3232a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675086 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791602.431581:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9ababb052400) 00010000:00010000:2.0:1788791602.431583:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788791602.431594:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c00800/0xcd6380150a322f4a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f98 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791602.431613:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9ababb052b00) 00010000:00010000:2.0:1788791602.431615:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788791602.431618:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01800/0xcd6380150a323666 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675182 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791602.431633:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9aba94530000) 00010000:00010000:2.0:1788791602.431635:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788791602.431639:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3234c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675112 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791602.431653:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9aba8823c700) 00010000:00010000:2.0:1788791602.431655:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788791602.431659:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a322fba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674fb4 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791602.431673:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9ababb052d00) 00010000:00010000:2.0:1788791602.431676:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788791602.431679:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a400/0xcd6380150a323b67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536752e0 expref: 11 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791602.431691:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ababb052300) 00010000:00010000:2.0:1788791602.431693:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788791602.431697:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9abab2c01a00/0xcd6380150a32364a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367517b expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791602.431706:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9aba8823c000) 00010000:00010000:2.0:1788791602.431714:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791602.431720:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a322f66 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f9f expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791602.431731:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9abab306a000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788791602.431742:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791602.431744:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791602.431746:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791602.851435:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791603.875736:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788791604.131357:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788791604.131365:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788791604.131671:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788791604.131677:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788791604.470400:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791604.470451:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791604.470489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791604.470527:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606370432 00000100:00100000:2.0:1788791604.470538:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606370432 00000100:00100000:1.0:1788791604.470583:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606370688 00000100:00100000:1.0:1788791604.470590:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606370688 00000100:00100000:2.0:1788791604.470608:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606370560 00000100:00100000:2.0:1788791604.470613:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606370560 00000100:00100000:1.0:1788791604.470627:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:1.0:1788791604.470639:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+12:2352:x1875683606370432:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791604.470655:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791604.470675:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16ca00/0xcd6380150a322d52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ed4 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791604.470692:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791604.470745:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:2352:x1875683606370432:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 109us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791604.473268:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:2.0:1788791604.473289:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa001c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+11:2352:x1875683606370688:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791604.473309:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791604.473331:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16c200/0xcd6380150a322f19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674f83 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791604.473348:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791604.473397:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa001c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+10:2352:x1875683606370688:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 118us (2946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791604.473405:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:2.0:1788791604.473426:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:2.0:1788791604.473432:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+9:2352:x1875683606370560:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791604.473455:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791604.474219:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16dc00/0xcd6380150a322d59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674efe expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791604.474231:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791604.474262:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+8:2352:x1875683606370560:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 830us (3773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791604.474270:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:2.0:1788791604.477670:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791604.477757:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606370944 00000100:00100000:3.0:1788791604.477767:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606370944 00000100:00100000:3.0:1788791604.477841:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 241 00000100:00100000:3.0:1788791604.477853:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28665881-f918-4421-b36a-72ee58aec27e+6:2351:x1875683606370944:12345-192.168.201.29@tcp:39:umount.0 00000020:00000080:3.0:1788791604.477892:0:5837:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322d67 00000020:00010000:3.0:1788791604.477901:0:5837:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9aba851e6000: total 0 00000100:00080000:3.0:1788791604.477906:0:5837:0:(import.c:65:import_set_state_nolock()) ffff9aba851e2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788791604.477928:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1788791604.478185:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:28665881-f918-4421-b36a-72ee58aec27e+5:2351:x1875683606370944:12345-192.168.201.29@tcp:39:umount.0 Request processed in 333us (523us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788791604.478193:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 241 00000020:00010000:3.0:1788791604.478214:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9aba851e6000: total 0 00010000:00010000:3.0:1788791604.478251:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9aba851e6000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788791604.478282:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9ababb052300) 00010000:00010000:3.0:1788791604.478286:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788791604.478294:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16c800/0xcd6380150a323c94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675334 expref: 4 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791604.478346:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9aba851e6000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788791604.478358:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791604.478361:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791604.478362:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788791604.478766:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791604.480805:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:2.0:1788791604.495168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791604.495275:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606371200 00000100:00100000:3.0:1788791604.495286:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606371200 00000100:00100000:3.0:1788791604.495349:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 304 00000100:00100000:3.0:1788791604.495364:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+7:2351:x1875683606371200:12345-192.168.201.29@tcp:251:umount.0 00000020:00000080:3.0:1788791604.495410:0:5832:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322c5d 00000020:00010000:3.0:1788791604.495418:0:5832:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9ababb5a6800: total 0 00000100:00080000:3.0:1788791604.495423:0:5832:0:(import.c:65:import_set_state_nolock()) ffff9ababb5a5000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788791604.495516:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:eeb43ea0-b4bb-4be2-baf9-261438e31ddf+3:2351:x1875683606371200:12345-192.168.201.29@tcp:251:umount.0 Request processed in 157us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791604.495524:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 304 00000020:00010000:2.0:1788791604.496073:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9ababb5a6800: total 0 00010000:00010000:2.0:1788791604.496078:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791604.496117:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9ababb5a6800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788791604.496186:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abaa1b5c400/0xcd6380150a322d13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453674ec6 expref: 2 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791604.496201:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9ababb5a6800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788791604.496211:0:5825:0:(genops.c:885:class_export_put()) final put ffff9ababb5a6800/eeb43ea0-b4bb-4be2-baf9-261438e31ddf 00010000:00010000:2.0:1788791604.496231:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791604.496233:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791604.496235:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788791604.496350:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababb5a6800/eeb43ea0-b4bb-4be2-baf9-261438e31ddf for MGS 00000020:00000080:0.0:1788791604.496389:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ababb5a5000 for MGS 00010000:00010000:0.0:1788791604.900430:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791605.927448:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791606.565886:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630464896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791606.566009:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791606.566119:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630464896 00000100:00100000:0.0:1788791606.566152:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630464896 00000100:00100000:0.0:1788791606.566226:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788791606.566238:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630464896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788791606.566283:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791606.566348:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630464896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791606.566356:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788791606.566419:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630464896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788791606.566511:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630465024:0@lo:400:kworker.0 00000100:00100000:0.0:1788791606.566550:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791606.566592:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630465024 00000100:00100000:0.0:1788791606.566596:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630465024 00000100:00100000:0.0:1788791606.566626:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788791606.566634:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba831ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630465024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791606.566689:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba831ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9967ad2d-016f-4163-8b2b-d5dc380f4403+19:3314:x1875683630465024:12345-0@lo:400:kworker.0 Request processed in 56us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791606.566696:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788791606.566748:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630465024:0@lo:400:kworker.0 00000100:00100000:0.0:1788791606.566778:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788791606.566784:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630465152:0@lo:400:kworker.0 00000100:00100000:0.0:1788791606.566817:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791606.566857:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630465152 00000100:00100000:0.0:1788791606.566861:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630465152 00000100:00100000:0.0:1788791606.566900:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788791606.566913:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630465152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791606.567209:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630465152:12345-0@lo:400:kworker.0 Request processed in 300us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791606.567217:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788791606.567242:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630465152:0@lo:400:kworker.0 00000100:00100000:0.0:1788791606.567279:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630465280:0@lo:400:kworker.0 00000100:00100000:0.0:1788791606.567310:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791606.567354:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630465280 00000100:00080000:3.0:1788791606.567361:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788791606.567361:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630465280 00000100:00100000:0.0:1788791606.567414:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788791606.567423:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630465280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791606.567470:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630465280:12345-0@lo:400:kworker.0 Request processed in 48us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791606.567479:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:0.0:1788791606.567504:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791606.567534:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630465280:0@lo:400:kworker.0 00000100:00100000:0.0:1788791606.567557:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630465408:0@lo:400:kworker.0 00000100:00100000:0.0:1788791606.567592:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791606.567656:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630465536:0@lo:400:kworker.0 00000100:00100000:0.0:1788791606.567681:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791606.567705:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630465536 00000100:00100000:0.0:1788791606.567709:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630465536 00000100:00100000:0.0:1788791606.567752:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788791606.567758:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630465536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791606.567795:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630465536:12345-0@lo:400:kworker.0 Request processed in 37us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791606.567801:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1788791606.567814:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791606.567834:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630465536:0@lo:400:kworker.0 00000100:00100000:3.0:1788791606.567866:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630465408 00000100:00100000:3.0:1788791606.567875:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630465408 00000100:00100000:3.0:1788791606.568299:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788791606.568313:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630465408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791606.568407:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630465408:12345-0@lo:400:kworker.0 Request processed in 99us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791606.568415:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1788791606.568916:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788791606.568965:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630465408:0@lo:400:kworker.0 00000001:00100000:1.0:1788791606.604948:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00000020:00000080:1.0:1788791606.604959:0:6705:0:(genops.c:885:class_export_put()) final put ffff9abab7a73800/aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00000020:00000080:2.0:1788791606.605409:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9abab7a73800/aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 for lustre-OST0000 00000020:00000080:2.0:1788791606.611941:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9abab7a72000 for lustre-OST0000 00000020:01000004:3.0:1788791606.815294:0:12958:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788791606.828256:0:12958:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788791606.828306:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ce9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.828332:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322ce9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.828340:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322ce9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.828347:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322ce9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.828379:0:12958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791606.828418:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791606.828434:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322ce9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791606.828447:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba80030800 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791606.828453:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322ce9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791606.828465:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a322ce9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791606.828473:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a322ce9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791606.828496:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788791606.828499:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788791606.828515:0:12958:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 10000000:01000000:3.0:1788791606.828520:0:12958:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788791606.828545:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788791606.828548:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788791606.828554:0:12958:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1788791606.828557:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a322ce9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791606.828566:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:3.0:1788791606.828580:0:12958:0:(import.c:65:import_set_state_nolock()) ffff9abab29f9800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788791606.828618:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a322ce9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791606.828629:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba80030800/0xcd6380150a322ce2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a322ce9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791606.828647:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875683630465792:0@lo:39:umount.0 00010000:00010000:0.0:1788791606.828651:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791606.828655:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791606.828658:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791606.828672:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788791606.828693:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630465664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791606.828740:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791606.828819:0:8351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630465792 00000100:00100000:3.0:1788791606.828825:0:8351:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630465792 00000100:00100000:3.0:1788791606.828873:0:8351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788791606.828882:0:8351:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875683630465792:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788791606.828907:0:8351:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322a6c 00000100:00080000:3.0:1788791606.828915:0:8351:0:(import.c:65:import_set_state_nolock()) ffff9ababc175800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788791606.829236:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791606.837684:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791606.837715:0:8351:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3311:x1875683630465792:12345-0@lo:39:umount.0 Request processed in 8825us (8978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791606.837727:0:8351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1788791606.837761:0:8351:0:(genops.c:885:class_export_put()) final put ffff9ababc172000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788791606.837810:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababc172000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788791606.837917:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ababc175800 for lustre-MDT0000 00000100:00080000:2.0:1788791606.837980:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9abab29f9800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788791606.837999:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875683630465792:0@lo:39:umount.0 00000100:00080000:3.0:1788791606.838015:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788791606.838201:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788791606.838206:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788791606.838908:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322cf7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.838917:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322cf7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.838922:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322cf7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.838926:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322cf7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.838944:0:12958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791606.838948:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322c1e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.838952:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322c1e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.838955:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322c1e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.838959:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322c1e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.838973:0:12958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788791606.838978:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322f12 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.838989:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322f12 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.838993:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322f12 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.838996:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322f12 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.839000:0:12958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788791606.839004:0:12958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5de00/0xcd6380150a3229cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3229d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.839007:0:12958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5de00/0xcd6380150a3229cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a3229d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.839010:0:12958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5de00/0xcd6380150a3229cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a3229d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.839014:0:12958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5de00/0xcd6380150a3229cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a3229d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791606.839018:0:12958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788791606.839020:0:12958:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788791606.839165:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788791606.839172:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322cf7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839180:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abac2170800 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791606.839183:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322cf7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839189:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a322cf7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791606.839194:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a322cf7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791606.839198:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788791606.839200:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788791606.839201:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788791606.839235:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a322cf7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839238:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791606.839259:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a322cf7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839263:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abac2170800/0xcd6380150a322cf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a322cf7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839282:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788791606.839284:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322c1e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839287:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe800 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791606.839290:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322c1e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839293:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a322c1e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791606.839296:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a322c1e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791606.839299:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788791606.839301:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788791606.839302:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788791606.839313:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a322c1e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839318:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791606.839324:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a322c1e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839330:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a322c17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a322c1e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839341:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788791606.839344:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322f12 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839354:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81524e00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791606.839357:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322f12 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839364:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a322f12 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791606.839369:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a322f12 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791606.839374:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788791606.839377:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788791606.839378:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788791606.839391:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a322f12 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839397:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791606.839413:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a322f12 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839420:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba81524e00/0xcd6380150a322f0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a322f12 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839429:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791606.839431:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5de00/0xcd6380150a3229cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a3229d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839434:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abaa1b5de00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791606.839436:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5de00/0xcd6380150a3229cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a3229d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839445:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5de00/0xcd6380150a3229cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a3229d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791606.839449:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5de00/0xcd6380150a3229cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a3229d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791606.839452:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788791606.839453:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788791606.839454:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788791606.839463:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5de00/0xcd6380150a3229cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a3229d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839466:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791606.839469:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5de00/0xcd6380150a3229cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a3229d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839473:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5de00/0xcd6380150a3229cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a3229d2 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.839480:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791606.839481:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791606.839482:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791606.839496:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630465920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791606.839539:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:3.0:1788791606.839661:0:12958:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788791606.839664:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788791606.839667:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788791606.839671:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:3.0:1788791606.839675:0:12958:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ab981269800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788791606.839692:0:12958:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9ab9818e7800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788791606.839697:0:12958:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9aba851e6000 28665881-f918-4421-b36a-72ee58aec27e 192.168.201.29@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788791606.839700:0:12958:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9abab306a000 aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 192.168.201.29@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967520 stale:0 00000020:00080000:3.0:1788791606.839704:0:12958:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9ababc14cd28) has exports, disconnecting them 00000020:00080000:3.0:1788791606.839707:0:12958:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ab981269800), last request at 1788791606 00000020:00000080:3.0:1788791606.839712:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322bdf 00000100:00080000:3.0:1788791606.839724:0:12958:0:(import.c:65:import_set_state_nolock()) ffff9ab98126e000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788791606.839768:0:12958:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ab981269800): rc 0 00000020:00000080:3.0:1788791606.839770:0:12958:0:(genops.c:885:class_export_put()) final put ffff9ab981269800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788791606.839776:0:12958:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9ab9818e7800), last request at 1788791606 00000020:00000080:3.0:1788791606.839778:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322b14 00000100:00080000:3.0:1788791606.839783:0:12958:0:(import.c:65:import_set_state_nolock()) ffff9ab9818e3000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788791606.839787:0:12958:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ab9818e7800): rc 0 00000020:00000080:3.0:1788791606.839788:0:12958:0:(genops.c:885:class_export_put()) final put ffff9ab9818e7800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788791606.839793:0:12958:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffadda42a2fae0 00000100:00080000:3.0:1788791606.839808:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788791606.839810:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1788791606.839819:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788791606.839871:0:12958:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788791606.839881:0:12958:0:(import.c:65:import_set_state_nolock()) ffff9ababefd3000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788791606.839889:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788791606.839891:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1788791606.839896:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788791606.839944:0:12958:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788791606.839948:0:12958:0:(import.c:65:import_set_state_nolock()) ffff9ab981ba4800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788791606.839967:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ababc14cd28) has no exports 00010000:00010000:0.0:1788791606.840365:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791606.841240:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630466304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788791606.841297:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630466048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788791606.841336:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791606.841350:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630466176:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788791606.841449:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ab981269800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788791606.841531:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ab9818e7800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788791606.841564:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ab98126e000 for lustre-MDT0000 00000020:00000080:0.0:1788791606.841574:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ab9818e3000 for lustre-MDT0000 00000100:00100000:0.0:1788791606.841599:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630466432:0@lo:9:umount.0 00000100:00100000:0.0:1788791606.841674:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791606.841718:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630466560:0@lo:9:umount.0 00000100:00100000:0.0:1788791606.841876:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791606.841955:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630466432 00000100:00100000:0.0:1788791606.841964:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630466432 00000100:00100000:0.0:1788791606.842014:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630466560 00000100:00100000:3.0:1788791606.842171:0:10087:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788791606.842186:0:10087:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875683630466432:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788791606.842223:0:10087:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322b61 00000100:00080000:3.0:1788791606.842235:0:10087:0:(import.c:65:import_set_state_nolock()) ffff9ab9818e6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788791606.842282:0:10087:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788791606.842686:0:10087:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3311:x1875683630466432:12345-0@lo:9:umount.0 Request processed in 502us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791606.842694:0:10087:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1788791606.842719:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788791606.842839:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ababefd3000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788791606.842855:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788791606.842858:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788791606.842862:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630466432:0@lo:9:umount.0 00000100:00100000:0.0:1788791606.843301:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630466560 00000100:00100000:0.0:1788791606.843352:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788791606.843362:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875683630466560:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788791606.843383:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322c48 00000100:00080000:0.0:1788791606.843392:0:6683:0:(import.c:65:import_set_state_nolock()) ffff9ab981ba1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788791606.843421:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788791606.843581:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3311:x1875683630466560:12345-0@lo:9:umount.0 Request processed in 220us (1704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791606.843588:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1788791606.843669:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788791606.843698:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ab981ba4800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788791606.843716:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788791606.843718:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788791606.843722:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630466560:0@lo:9:umount.0 00000100:00100000:3.0:1788791606.844049:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791606.847811:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630465664 00000100:00100000:1.0:1788791606.847833:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630465664 00000100:00100000:2.0:1788791606.847838:0:12870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630465920 00000100:00100000:2.0:1788791606.847858:0:12870:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630465920 00000100:00100000:0.0:1788791606.847903:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630466176 00000100:00100000:0.0:1788791606.847912:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630466176 00000100:00100000:1.0:1788791606.847961:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788791606.847970:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791606.847978:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788791606.847981:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+21:3314:x1875683630465664:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788791606.848001:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+21:3312:x1875683630465920:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791606.848002:0:12870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788791606.848003:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788791606.848026:0:12870:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9967ad2d-016f-4163-8b2b-d5dc380f4403+21:3314:x1875683630466176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788791606.848033:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791606.848034:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abac2170200/0xcd6380150a322ce9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a322ce2 expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791606.848045:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abaa1b5c200/0xcd6380150a322cf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a322cf0 expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.848049:0:12870:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791606.848066:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788791606.848069:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788791606.848232:0:12870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994ffe00/0xcd6380150a322f12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a322f0b expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791606.848248:0:12870:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791606.849031:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:3314:x1875683630465664:12345-0@lo:103:ldlm_bl.0 Request processed in 1049us (11354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791606.849044:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788791606.849075:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630466048 00000100:00100000:1.0:1788791606.849080:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630466048 00000100:00100000:1.0:1788791606.849108:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788791606.849115:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+18:3313:x1875683630466048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791606.849141:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791606.849155:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba81525000/0xcd6380150a322c1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a322c17 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791606.849185:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791606.849222:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:3313:x1875683630466048:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791606.849228:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788791606.850365:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9967ad2d-016f-4163-8b2b-d5dc380f4403:3313:1875683630466048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788791606.850414:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630465664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788791606.850468:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630465920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788791606.851248:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791606.851297:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630466304 00000100:00100000:1.0:1788791606.851310:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630466304 00000100:00100000:1.0:1788791606.851368:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788791606.851378:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9967ad2d-016f-4163-8b2b-d5dc380f4403+17:3315:x1875683630466304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791606.851394:0:8452:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791606.851414:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba81524a00/0xcd6380150a3229d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a3229cb expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791606.851436:0:8452:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791606.852884:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:3312:x1875683630465920:12345-0@lo:103:ldlm_bl.0 Request processed in 4886us (13331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791606.852901:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788791606.852924:0:12870:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9967ad2d-016f-4163-8b2b-d5dc380f4403+16:3314:x1875683630466176:12345-0@lo:103:ldlm_bl.0 Request processed in 4897us (8886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791606.852941:0:12870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788791606.853011:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9967ad2d-016f-4163-8b2b-d5dc380f4403:3314:1875683630466176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791606.856500:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9967ad2d-016f-4163-8b2b-d5dc380f4403+14:3315:x1875683630466304:12345-0@lo:103:ldlm_bl.0 Request processed in 5112us (5244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791606.856516:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788791606.856683:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630466304:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788791606.858647:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9ababc14cd28) has no exports 00000020:00000080:0.0:1788791606.925792:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322a26 00000020:00000080:0.0:1788791606.925811:0:12958:0:(genops.c:885:class_export_put()) final put ffff9ababbc11000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788791606.926189:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788791606.926205:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababbc11000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788791606.926282:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788791606.926292:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788791606.926297:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9ababc020000) has no exports 00000020:00000080:2.0:1788791606.927408:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322a1f 00000020:00000080:2.0:1788791606.927418:0:12958:0:(genops.c:885:class_export_put()) final put ffff9ababbc07800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788791606.927567:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababbc07800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788791606.927722:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788791606.927743:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788791606.927747:0:12958:0:(genops.c:885:class_export_put()) final put ffff9ababbc03800/lustre-QMT0000_UUID 00000020:00000080:2.0:1788791606.927750:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababbc03800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788791606.927761:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1788791606.947264:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788791607.141412:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00000001:00080000:1.0:1788791607.141430:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:1.0:1788791607.141461:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 28665881-f918-4421-b36a-72ee58aec27e 00000001:00080000:1.0:1788791607.141468:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788791607.141472:0:5859:0:(genops.c:885:class_export_put()) final put ffff9aba851e6000/28665881-f918-4421-b36a-72ee58aec27e 00000020:00000080:1.0:1788791607.141498:0:5859:0:(genops.c:885:class_export_put()) final put ffff9abab306a000/aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00000020:00000080:1.0:1788791607.141521:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba851e6000/28665881-f918-4421-b36a-72ee58aec27e for lustre-MDT0000 00000020:00000080:1.0:1788791607.141581:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9abab306a000/aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 for lustre-MDT0000 00000020:00000080:1.0:1788791607.141613:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9aba851e2000 for lustre-MDT0000 00000020:00000080:1.0:1788791607.141617:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9abab306b000 for lustre-MDT0000 00000001:00100000:3.0:1788791607.146222:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788791607.146231:0:7644:0:(genops.c:885:class_export_put()) final put ffff9ab981ba5000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788791607.146261:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00000020:00000080:3.0:1788791607.146264:0:7644:0:(genops.c:885:class_export_put()) final put ffff9aba867b2000/aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 00000020:00000080:0.0:1788791607.146330:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9ab981ba5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788791607.146389:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba867b2000/aafa64f5-7c0a-45ff-aeda-f3a6deb3b804 for lustre-OST0001 00000020:00000080:0.0:1788791607.146410:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ab981ba1800 for lustre-OST0001 00000020:00000080:0.0:1788791607.146415:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9aba867b7800 for lustre-OST0001 00010000:00010000:3.0:1788791607.973074:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788791608.932890:0:12958:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9aba98ee0600 - data ffff9abab7d05438/ffff9ababb9a5800 00000020:01000000:3.0:1788791608.933017:0:12958:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9aba89109240 - data ffff9abaacb51e58/ffff9abab29c2000 00000001:00000004:3.0:1788791608.943430:0:12958:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00010000:00010000:2.0:1788791608.995837:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788791609.058841:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788791609.058850:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788791609.058930:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788791609.058934:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788791609.063529:0:6721:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788791609.063537:0:6721:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1788791609.063549:0:6721:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788791609.064480:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788791609.064486:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788791609.064506:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788791609.064509:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788791609.064806:0:7979:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788791609.064811:0:7979:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788791609.064820:0:7979:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788791609.115012:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a3229ee 00000020:00000080:2.0:1788791609.115024:0:12958:0:(genops.c:885:class_export_put()) final put ffff9ababc173000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788791609.115145:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababc173000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788791609.119388:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322a03 00000020:00000080:2.0:1788791609.119400:0:12958:0:(genops.c:885:class_export_put()) final put ffff9ababc172800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788791609.119417:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788791609.119422:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788791609.119430:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788791609.119434:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9ababc148000) has no exports 00000020:00000080:3.0:1788791609.119504:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababc172800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1788791609.119583:0:12958:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788791609.119590:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322c41 00000020:00000080:2.0:1788791609.119594:0:12958:0:(genops.c:885:class_export_put()) final put ffff9ababb5a5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788791609.119607:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788791609.119610:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788791609.119616:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788791609.119619:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9aba88c63370) has no exports 00000020:00000080:2.0:1788791609.119624:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322c3a 00000020:00000080:2.0:1788791609.119628:0:12958:0:(genops.c:885:class_export_put()) final put ffff9ab981ba6800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788791609.119702:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababb5a5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788791609.119709:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ab981ba6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788791609.119944:0:12958:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788791609.119949:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788791609.119952:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788791609.119958:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788791609.119960:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788791609.119993:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ab981ba4800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788791609.119993:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788791609.120000:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788791609.120003:0:12958:0:(genops.c:885:class_export_put()) final put ffff9aba98e81000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788791609.120006:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba98e81000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788791609.120012:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788791609.120072:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322b5a 00000020:00000080:2.0:1788791609.120076:0:12958:0:(genops.c:885:class_export_put()) final put ffff9ababefd7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788791609.120089:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788791609.120092:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788791609.120096:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788791609.120104:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9ababc0219b8) has no exports 00000020:00000080:2.0:1788791609.120108:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322b53 00000020:00000080:2.0:1788791609.120110:0:12958:0:(genops.c:885:class_export_put()) final put ffff9ababefd7800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788791609.120180:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababefd7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788791609.120185:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababefd7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788791609.120442:0:12958:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788791609.120445:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788791609.120447:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788791609.120451:0:12958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788791609.120453:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788791609.120487:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788791609.120493:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788791609.120505:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ababefd3000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788791609.120515:0:36:0:(genops.c:885:class_export_put()) final put ffff9ababab17000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788791609.120516:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788791609.120518:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababab17000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788791609.120519:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788791609.120521:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788791609.120521:0:12958:0:(genops.c:885:class_export_put()) final put ffff9abab2988800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788791609.120524:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff9abab2988800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788791609.120527:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788791609.123897:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322a0a 00000020:00000080:3.0:1788791609.123911:0:12958:0:(genops.c:885:class_export_put()) final put ffff9ababc177000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788791609.123932:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788791609.123938:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788791609.123947:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788791609.123951:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9ababc14b370) has no exports 00000020:00000080:3.0:1788791609.123980:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788791609.123985:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788791609.123989:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322a11 00000020:00000080:3.0:1788791609.123993:0:12958:0:(genops.c:885:class_export_put()) final put ffff9ababc176000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788791609.124002:0:12958:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9aba98e4f000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788791609.124005:0:12958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9aba98e4f000 3 00000020:01000004:3.0:1788791609.124008:0:12958:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9aba98e4f000 from lustre-MDT0000 00000020:00000080:3.0:1788791609.124026:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788791609.124029:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788791609.124032:0:12958:0:(genops.c:885:class_export_put()) final put ffff9ababc177800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788791609.124035:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababc177800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788791609.124043:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788791609.124084:0:12958:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788791609.124087:0:12958:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788791609.124090:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788791609.124093:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788791609.124096:0:12958:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788791609.124102:0:12958:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9aba892e0000 9967ad2d-016f-4163-8b2b-d5dc380f4403 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788791609.124107:0:12958:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9aba98064d28) has exports, disconnecting them 00000020:00080000:3.0:1788791609.124112:0:12958:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9aba892e0000), last request at 1788791377 00000020:00000080:3.0:1788791609.124157:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a3229af 00000020:00010000:3.0:1788791609.124162:0:12958:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9aba892e0000: total 2 00000100:00080000:3.0:1788791609.124178:0:12958:0:(import.c:65:import_set_state_nolock()) ffff9aba892e4000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788791609.124193:0:12958:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9aba892e0000): rc 0 00000020:00080000:3.0:1788791609.124197:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9aba98064d28) has no exports 00000100:00100000:3.0:1788791609.124307:0:5831:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9aba85634e00:5831] 1 exiting: rc = 0 00000020:00010000:0.0:1788791609.124539:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9aba892e0000: total 2 00010000:00010000:0.0:1788791609.124575:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9aba892e0000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788791609.124603:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994ff400/0xcd6380150a322f04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a322efd expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791609.124618:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16d800/0xcd6380150a322ef6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a322eef expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791609.124634:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba81524c00/0xcd6380150a322ac7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a322ac0 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791609.124646:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba80031a00/0xcd6380150a322d05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a322cfe expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791609.124658:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abac2171600/0xcd6380150a322cbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a322cb8 expref: 5 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791609.124668:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994ff800/0xcd6380150a322cb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a322caa expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791609.124677:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abac2171800/0xcd6380150a322ccd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a322cc6 expref: 3 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791609.124685:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba80030c00/0xcd6380150a322cdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd6380150a322cd4 expref: 2 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791609.124721:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9aba892e0000, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788791609.124737:0:5825:0:(genops.c:885:class_export_put()) final put ffff9aba892e0000/9967ad2d-016f-4163-8b2b-d5dc380f4403 00010000:00010000:0.0:1788791609.124743:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791609.124745:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791609.124747:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791609.124773:0:5832:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9aba85635800:5832] 2 exiting: rc = 0 00000100:00100000:1.0:1788791609.124996:0:5830:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9aba85634000:5830] 0 exiting: rc = 1 00000100:00100000:3.0:1788791609.125216:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125224:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125231:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125236:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125242:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125248:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125254:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125259:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125265:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125271:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125277:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125294:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125300:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125305:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125311:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125317:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125323:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125329:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125335:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125341:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125347:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125353:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125358:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125364:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125370:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125375:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125381:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125387:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125393:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125399:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125412:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125418:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125423:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125428:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125555:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125562:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125568:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125573:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125579:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788791609.125583:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababc177000/lustre-MDD0000_UUID for lustre-MDD0000 00000100:00100000:3.0:1788791609.125585:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125590:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788791609.125590:0:36:0:(genops.c:885:class_export_put()) final put ffff9ababc171800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788791609.125592:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababc171800/lustre-MDD0000_UUID for lustre-MDD0000 00000100:00100000:3.0:1788791609.125596:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:2.0:1788791609.125600:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:3.0:1788791609.125601:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125606:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125611:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125617:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125622:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125626:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125631:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125636:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125641:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125646:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125651:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125655:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125660:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125664:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125669:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125675:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125680:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125685:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125703:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125709:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125715:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.125720:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788791609.125779:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababc176000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788791609.125784:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba892e0000/9967ad2d-016f-4163-8b2b-d5dc380f4403 for MGS 00000020:00000080:2.0:1788791609.125818:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9aba892e4000 for MGS 20000000:01000000:3.0:1788791609.126080:0:12958:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788791609.126088:0:12958:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1788791609.126840:0:12958:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9abab7885180 - data ffff9abab7dd0360/ffff9abab3059c00 00000020:01000000:0.0:1788791609.126956:0:12958:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9aba8805ed80 - data ffff9abaacb6a360/ffff9aba87da2800 00000020:00000080:0.0:1788791609.127417:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322993 00000020:00000080:0.0:1788791609.127424:0:12958:0:(genops.c:885:class_export_put()) final put ffff9aba84c03000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788791609.127598:0:12958:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9aba98e4f000 from MGS, refs=2 00000020:01000004:0.0:1788791609.127601:0:12958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9aba98e4f000 2 00000020:01000004:0.0:1788791609.127604:0:12958:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9aba98e4f000 from MGS 00000020:00000080:0.0:1788791609.127622:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788791609.127627:0:12958:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788791609.127630:0:12958:0:(genops.c:885:class_export_put()) final put ffff9aba98aa8000/MGS 00000020:00000080:0.0:1788791609.127633:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba98aa8000/MGS for MGS 00000020:01000000:0.0:1788791609.127638:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788791609.127683:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788791609.127686:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788791609.127709:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788791609.127715:0:12958:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9abab29ff000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788791609.127721:0:12958:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9ababc024d28) has exports, disconnecting them 00000020:00080000:0.0:1788791609.127725:0:12958:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9abab29ff000), last request at 1788791378 00000020:00000080:0.0:1788791609.127729:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322a5e 00000020:00080000:0.0:1788791609.127739:0:12958:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9abab29ff000): rc 0 00000020:00000080:0.0:1788791609.127744:0:12958:0:(genops.c:885:class_export_put()) final put ffff9abab29ff000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788791609.128091:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba84c03000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788791609.128100:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9abab29ff000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788791609.129412:0:12958:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788791609.129418:0:12958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788791609.129423:0:12958:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788791609.129429:0:12958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788791609.129615:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9abab29f9800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788791609.129782:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788791609.129790:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788791609.129805:0:12958:0:(genops.c:885:class_export_put()) final put ffff9ababbc02000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788791609.129809:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababbc02000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788791609.129815:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788791609.129869:0:12958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9aba98e4f000 1 00000020:00000080:2.0:1788791609.129874:0:12958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322985 00000020:00000080:2.0:1788791609.129879:0:12958:0:(genops.c:885:class_export_put()) final put ffff9aba98aa8800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788791609.129888:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788791609.129895:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba98aa8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788791609.129904:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788791609.129908:0:12958:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788791609.129912:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9aba98060000) has no exports 00000020:00000080:2.0:1788791609.193769:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788791609.193783:0:12958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788791609.193798:0:12958:0:(genops.c:885:class_export_put()) final put ffff9aba98e4e000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788791609.193803:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba98e4e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788791609.193809:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788791609.193926:0:12958:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9aba98e4c800 00000020:01000000:2.0:1788791609.193949:0:12958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788791609.193953:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788791609.193957:0:12958:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788791609.193961:0:12958:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9aba98063370) has no exports 00000100:00100000:2.0:1788791609.194024:0:5837:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9aba86702e00:5837] 1 exiting: rc = 0 00000100:00100000:2.0:1788791609.194113:0:8351:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9aba87ce4800:8351] 3 exiting: rc = 0 00000100:00100000:3.0:1788791609.197942:0:5839:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9aba85654a00:5839] 2 exiting: rc = 0 00000100:00100000:3.0:1788791609.198590:0:5836:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9aba86702000:5836] 0 exiting: rc = 1 00000100:00100000:2.0:1788791609.199892:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.199903:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.199909:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.199915:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.199921:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.199927:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.199950:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.199956:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.199963:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.199969:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.199975:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.199981:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.199987:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.199993:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.199998:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200004:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200009:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200016:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200022:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200027:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200033:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200038:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200045:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200050:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200056:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200062:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200068:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200074:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200079:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200085:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200090:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200096:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200101:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200108:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200115:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200120:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200147:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200154:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200159:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200164:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200169:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200182:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200187:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200193:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200199:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200205:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200210:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200216:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200222:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200239:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200247:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200252:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200258:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200263:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200268:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200273:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200279:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200285:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200291:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200296:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200302:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200308:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200314:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.200331:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214202:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9aba8577ba00:5840] 0 exiting: rc = 1 00000100:00100000:2.0:1788791609.214513:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9aba86703c00:5841] 1 exiting: rc = 0 00000100:00100000:3.0:1788791609.214786:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214796:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214802:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214808:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214814:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214820:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214826:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214833:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214841:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214847:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214854:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214860:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214867:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214873:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214878:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214884:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214890:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214895:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214901:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214906:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214911:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214917:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214922:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214928:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214933:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214939:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214944:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214951:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214957:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214963:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214969:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214988:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.214995:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215014:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215020:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215026:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215032:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215038:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215043:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215049:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215054:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215060:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215065:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215070:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215076:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215080:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215086:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215091:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215096:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215100:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215107:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215112:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215119:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215150:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215157:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215162:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215168:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215172:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215178:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215183:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215190:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215196:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215202:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.215209:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.216077:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9aba856b3e00:5842] 0 exiting: rc = 1 00000100:00100000:0.0:1788791609.217515:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9aba8577be00:5843] 1 exiting: rc = 0 00000100:00100000:3.0:1788791609.217685:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217703:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217720:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217726:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217736:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217745:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217751:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217764:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217770:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217775:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217783:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217789:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217801:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217807:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217812:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217818:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217823:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217828:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217833:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217851:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217857:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217862:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217867:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217872:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217877:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217882:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217888:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217893:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217898:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217903:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217908:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217923:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217929:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217934:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217940:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217945:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217950:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217959:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217967:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217972:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217982:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217987:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.217993:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218011:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218017:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218023:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218029:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218035:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218041:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218047:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218053:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218059:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218064:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218084:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218090:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218108:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218258:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218264:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218270:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218276:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218282:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218288:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218293:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.218302:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.242709:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9aba82f40a00:5844] 0 exiting: rc = 1 00000100:00100000:1.0:1788791609.243780:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9aba82f40c00:5845] 1 exiting: rc = 0 00000100:00100000:2.0:1788791609.244172:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244180:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244187:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244193:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244200:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244208:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244215:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244221:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244228:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244246:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244251:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244257:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244264:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244271:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244295:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244302:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244308:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244314:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244321:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244327:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244333:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244339:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244345:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244351:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244357:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244363:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244369:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244375:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244380:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244386:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244391:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244396:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244401:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244406:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244413:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244420:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244426:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244431:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244437:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244443:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244449:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244455:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244461:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244467:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244482:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244488:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244494:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244501:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244506:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244512:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244518:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244525:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244531:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244536:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244541:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244547:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244552:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244558:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244564:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244571:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244577:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244583:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244589:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.244596:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.245059:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9aba82f40200:5846] 0 exiting: rc = 1 00000100:00100000:1.0:1788791609.246834:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9aba82f41000:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1788791609.247968:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.247976:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.247982:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.247986:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.247992:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248074:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248081:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248087:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248091:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248096:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248101:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248107:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248112:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248117:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248146:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248151:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248156:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248162:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248167:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248172:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248177:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248182:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248187:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248191:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248197:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248202:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248207:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248212:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248217:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248222:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248228:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248244:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248248:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248254:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248260:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248265:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248270:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248288:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248293:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248298:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248304:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248309:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248315:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248320:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248325:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248330:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248336:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248342:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248347:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248364:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248370:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248377:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248383:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248389:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248396:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248401:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248407:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248413:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248420:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248426:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248432:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248438:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248444:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.248451:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788791609.248931:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9aba82f41a00:5848] 0 exiting: rc = 1 00000100:00100000:1.0:1788791609.249487:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9aba82f41e00:5849] 1 exiting: rc = 0 00000100:00100000:2.0:1788791609.249808:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249816:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249820:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249825:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249829:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249835:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249840:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249846:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249851:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249857:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249862:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249867:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249874:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249881:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249888:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249895:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249901:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249908:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249914:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249920:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249937:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249944:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249951:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249958:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249964:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249970:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249975:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249982:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249988:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.249994:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250077:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250086:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250091:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250095:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250100:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250104:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250109:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250113:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250118:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250158:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250166:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250170:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250176:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250181:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250186:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250191:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250196:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250201:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250206:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250210:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250216:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250220:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250226:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250248:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250253:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250268:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250382:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250390:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250396:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250401:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250406:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250411:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250417:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.250422:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.251190:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9aba85651800:5852] 2 exiting: rc = 0 00000100:00100000:3.0:1788791609.251283:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9aba86702400:5850] 0 exiting: rc = 1 00000100:00100000:0.0:1788791609.255263:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9aba85651400:5851] 1 exiting: rc = 0 00000100:00100000:2.0:1788791609.255377:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255386:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255392:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255398:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255403:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255409:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255414:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255420:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255425:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255431:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255435:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255440:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255446:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255451:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255457:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255463:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255469:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255474:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255479:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255485:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255506:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255515:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255523:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255530:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255538:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255554:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255562:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255569:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255576:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255583:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255590:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255596:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255603:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255609:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255616:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255623:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255629:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255636:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255643:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255650:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255656:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255663:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255670:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255677:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255711:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255719:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255727:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255735:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255743:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255751:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255756:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255762:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255767:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255773:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255779:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255784:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255790:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255795:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255801:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255807:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255821:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255826:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255831:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791609.255837:0:12958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788791609.271653:0:12958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788791609.271667:0:12958:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788791609.271675:0:12958:0:(genops.c:885:class_export_put()) final put ffff9aba993a8800/MDS_uuid 00000020:00000080:0.0:1788791609.271680:0:12958:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba993a8800/MDS_uuid for MDS 00000020:01000000:0.0:1788791609.271699:0:12958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788791609.272297:0:12958:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788791610.021351:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791611.046593:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791611.686855:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630466688:0@lo:400:kworker.0 00000100:00100000:2.0:1788791611.686894:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630466944:0@lo:400:kworker.0 00000400:00000100:3.0:1788791611.686933:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875683630466688 offset 0 length 224: 4 00000400:00000100:2.0:1788791611.686970:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683630466944 offset 0 length 224: 4 00000100:00100000:1.0:1788791611.686991:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630466816:0@lo:400:kworker.0 00000400:00000100:1.0:1788791611.691465:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683630466816 offset 0 length 224: 4 00000001:00100000:1.0:1788791611.778512:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788791611.778523:0:6705:0:(genops.c:885:class_export_put()) final put ffff9ab9818e5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788791611.778593:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ab9818e5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788791611.778652:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ab9818e6800 for lustre-OST0000 00010000:00010000:0.0:1788791612.067395:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788791612.441971:0:13114:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788791612.471490:0:13114:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788791612.471566:0:13114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ccd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791612.471584:0:13114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322ccd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791612.471593:0:13114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322ccd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791612.471600:0:13114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322ccd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791612.471676:0:13114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788791612.471684:0:13114:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788791612.471718:0:13114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788791612.471733:0:13114:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ababb82df80 x1875683630466816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791627 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791612.471757:0:13114:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788791612.471766:0:13114:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788791612.471801:0:13114:0:(import.c:65:import_set_state_nolock()) ffff9ab9818e3800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788791612.472191:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875683630467072:0@lo:39:umount.0 00000100:00100000:1.0:1788791612.472195:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630466816:0@lo:400:kworker.0 00000400:00000100:2.0:1788791612.472270:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683630467072 offset 0 length 224: 4 00010000:00010000:0.0:1788791612.479534:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791612.479554:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322ccd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791612.479569:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abaa1b5c600 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791612.479574:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322ccd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791612.479587:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a322ccd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791612.479605:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a322ccd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791612.479612:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788791612.479615:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788791612.479620:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788791612.479784:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a322ccd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791612.479793:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791612.479830:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a322ccd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791612.479838:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c600/0xcd6380150a322cc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd6380150a322ccd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791612.479855:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791612.479876:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791612.479878:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791612.479926:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630467200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788791612.480025:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791612.480206:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630467200 00000100:00100000:0.0:1788791612.480217:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630467200 00000100:00100000:2.0:1788791612.480337:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788791612.480348:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abaa001d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3315:x1875683630467200:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788791612.480356:0:5823:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788791612 with bad export cookie 14799813628323309999 00000100:00100000:3.0:1788791612.495490:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abaa001d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3315:x1875683630467200:12345-0@lo:103:ldlm_bl.0 Request processed in 15129us (15453us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788791612.495509:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788791612.495764:0:3315:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788791612.495770:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9aba850fe000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788791612.495775:0:3315:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.129@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788791612.513456:0:3315:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.129@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788791612.513462:0:3315:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788791612.513471:0:3315:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ababb82fb80 x1875683630466688/t0(0) o400->MGC192.168.201.129@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788791627 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791612.513499:0:3315:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9abab2d50380 x1875683630467200/t0(0) o103->MGC192.168.201.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788791628 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788791612.513509:0:3315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788791612.513512:0:3315:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788791612.513514:0:3315:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788791612.513518:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9aba850fe000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788791612.513524:0:3315:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 153 00000100:00080000:0.0:1788791612.513534:0:3315:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff9aba850fe000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788791612.513575:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9967ad2d-016f-4163-8b2b-d5dc380f4403:3312:1875683630466688:0@lo:400:kworker.0 00000100:00100000:1.0:1788791612.513760:0:3315:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9abab2d53100 x1875683630467328/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788791612.513812:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9967ad2d-016f-4163-8b2b-d5dc380f4403:3315:1875683630467200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791612.513899:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9967ad2d-016f-4163-8b2b-d5dc380f4403:3311:1875683630467328:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1788791612.513995:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875683630467328 offset 0 length 520: 4 00010000:00010000:0.0:1788791613.092336:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791614.118158:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791615.140844:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791616.168078:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788791616.803248:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9967ad2d-016f-4163-8b2b-d5dc380f4403->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788791616.803259:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9967ad2d-016f-4163-8b2b-d5dc380f4403->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788791616.803328:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630467456:0@lo:400:kworker.0 00000400:00000100:3.0:1788791616.803474:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683630467456 offset 0 length 224: 4 00010000:00010000:0.0:1788791617.187365:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791618.211948:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791619.235467:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791620.259404:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791621.283373:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788791621.923298:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9967ad2d-016f-4163-8b2b-d5dc380f4403->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788791621.923310:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9967ad2d-016f-4163-8b2b-d5dc380f4403->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788791621.923448:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630467584:0@lo:400:kworker.0 00000400:00000100:3.0:1788791621.923513:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683630467584 offset 0 length 224: 4 00010000:00010000:1.0:1788791622.307688:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791622.947512:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788791612/real 1788791612] req@ffff9abab2d53100 x1875683630467328/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788791622 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791622.947545:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9abab2d53100 x1875683630467328/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788791622 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791622.947558:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788791612/real 1788791612] req@ffff9ab982a3c000 x1875683630467072/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788791622 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791622.947570:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ab982a3c000 x1875683630467072/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788791622 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788791622.947585:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9aba850fe000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788791622.947609:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788791622.947612:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9967ad2d-016f-4163-8b2b-d5dc380f4403:3311:1875683630467328:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1788791622.947619:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ab9818e3800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788791622.947640:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875683630467072:0@lo:39:umount.0 00000100:00080000:2.0:1788791622.947793:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9967ad2d-016f-4163-8b2b-d5dc380f4403->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788791622.947799:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788791622.947802:0:36:0:(import.c:65:import_set_state_nolock()) ffff9aba850fe000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788791622.947807:0:36:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 388 00000100:00080000:2.0:1788791622.947812:0:36:0:(import.c:589:import_select_connection()) MGC192.168.201.129@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788791622.947819:0:36:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff9aba850fe000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788791622.947851:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ababb040380 x1875683630467712/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788791622.947953:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788791622.947967:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630467840:0@lo:400:kworker.0 00000100:00080000:0.0:1788791622.948009:0:13114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788791622.948015:0:13114:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788791622.948020:0:13114:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000400:00000100:1.0:1788791622.948028:0:3315:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683630467840 offset 0 length 224: 4 00000100:00100000:3.0:1788791622.948564:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9967ad2d-016f-4163-8b2b-d5dc380f4403:3311:1875683630467712:0@lo:250:kworker.0 00000400:00000100:3.0:1788791622.948594:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875683630467712 offset 0 length 520: 4 00010000:00010000:0.0:1788791622.950165:0:13114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d800/0xcd6380150a322cd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322cdb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791622.950183:0:13114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d800/0xcd6380150a322cd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322cdb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791622.950190:0:13114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d800/0xcd6380150a322cd4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322cdb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791622.950210:0:13114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d800/0xcd6380150a322cd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322cdb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791622.950241:0:13114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791622.950249:0:13114:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c600/0xcd6380150a322efd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322f04 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791622.950256:0:13114:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c600/0xcd6380150a322efd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322f04 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791622.950263:0:13114:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c600/0xcd6380150a322efd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322f04 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791622.950269:0:13114:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9ababb16c600/0xcd6380150a322efd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322f04 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791622.950291:0:13114:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788791622.950297:0:13114:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788791622.950324:0:13114:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788791622.950329:0:13114:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788791622.950334:0:13114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788791622.950339:0:13114:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788791622.950344:0:13114:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9ababc1499b8) has no exports 00010000:00010000:2.0:1788791622.950370:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:0.0:1788791622.950373:0:13114:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9ababc1499b8) has no exports 00010000:00010000:2.0:1788791622.950379:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d800/0xcd6380150a322cd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322cdb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791622.950397:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abaa1b5d800 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791622.950401:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d800/0xcd6380150a322cd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322cdb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791622.950412:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d800/0xcd6380150a322cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a322cdb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791622.950429:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d800/0xcd6380150a322cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a322cdb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791622.950435:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788791622.950438:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788791622.950440:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788791622.950465:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9aba850fe000 00010000:00010000:2.0:1788791622.950470:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d800/0xcd6380150a322cd4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a322cdb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791622.950477:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d800/0xcd6380150a322cd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a322cdb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791622.950492:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791622.950496:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9ababb16c600/0xcd6380150a322efd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322f04 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791622.950501:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c600 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791622.950504:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16c600/0xcd6380150a322efd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322f04 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791622.950511:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9ababb16c600/0xcd6380150a322efd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a322f04 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791622.950523:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16c600/0xcd6380150a322efd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a322f04 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791622.950529:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788791622.950531:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788791622.950533:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788791622.950541:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9aba850fe000 00010000:00010000:2.0:1788791622.950544:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9ababb16c600/0xcd6380150a322efd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a322f04 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791622.950551:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9ababb16c600/0xcd6380150a322efd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a322f04 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791622.950560:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791622.950562:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791622.950563:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791622.950886:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788791622.959848:0:13114:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9aba860c9c00 - data ffff9abab7dd00d8/ffff9abab3059000 00000020:01000000:0.0:1788791622.959980:0:13114:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ab9810c3720 - data ffff9ab98158a798/ffff9abab7a02800 00100000:10000000:3.0:1788791622.973347:0:13114:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788791623.012209:0:13114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322ae3 00000020:00000080:0.0:1788791623.012218:0:13114:0:(genops.c:885:class_export_put()) final put ffff9ab98126a800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788791623.012234:0:13114:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ababbc61000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788791623.012247:0:13114:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ababbc61000 2 00000020:01000004:0.0:1788791623.012251:0:13114:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ababbc61000 from lustre-OST0000 00000020:00000080:0.0:1788791623.012275:0:13114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788791623.012284:0:13114:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788791623.012288:0:13114:0:(genops.c:885:class_export_put()) final put ffff9ababc171000/lustre-OST0000_UUID 00000020:00000080:0.0:1788791623.012290:0:13114:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababc171000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788791623.012298:0:13114:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788791623.012339:0:13114:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788791623.012342:0:13114:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788791623.012346:0:13114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788791623.012350:0:13114:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788791623.012357:0:13114:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9ab9818e2000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788791623.012363:0:13114:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9aba88c64d28) has exports, disconnecting them 00000020:00080000:0.0:1788791623.012368:0:13114:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9ab9818e2000), last request at 1788791396 00000020:00000080:0.0:1788791623.012372:0:13114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322b0d 00000020:00080000:0.0:1788791623.012380:0:13114:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9ab9818e2000): rc 0 00000020:00000080:0.0:1788791623.012384:0:13114:0:(genops.c:885:class_export_put()) final put ffff9ab9818e2000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788791623.013240:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ab98126a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788791623.013252:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9ab9818e2000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788791623.057892:0:13114:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788791623.057902:0:13114:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788791623.057906:0:13114:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788791623.057913:0:13114:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788791623.061430:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9ab9818e3800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788791623.068701:0:13114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788791623.068716:0:13114:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788791623.068723:0:13114:0:(genops.c:885:class_export_put()) final put ffff9ababefd4000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788791623.068728:0:13114:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababefd4000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788791623.068741:0:13114:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788791623.068810:0:13114:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ababbc61000 1 00000020:00000080:1.0:1788791623.068816:0:13114:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322a9d 00000020:00000080:1.0:1788791623.068823:0:13114:0:(genops.c:885:class_export_put()) final put ffff9aba993f3800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788791623.068844:0:13114:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788791623.068848:0:13114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788791623.068854:0:13114:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788791623.068857:0:13114:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9ababc023370) has no exports 00000020:00000080:3.0:1788791623.070917:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba993f3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788791623.093712:0:13114:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788791623.093727:0:13114:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788791623.093745:0:13114:0:(genops.c:885:class_export_put()) final put ffff9ababbc67800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788791623.093751:0:13114:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababbc67800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788791623.093769:0:13114:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788791623.093902:0:13114:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ababbc62000 00000020:02000400:3.0:1788791623.093953:0:13114:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788791623.349166:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791624.363519:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791625.381298:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788791625.868308:0:13265:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788791625.884387:0:13265:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788791625.884486:0:13265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322caa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322cb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791625.884500:0:13265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322caa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322cb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791625.884507:0:13265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322caa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322cb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791625.884527:0:13265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322caa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322cb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791625.884550:0:13265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788791625.884556:0:13265:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788791625.884580:0:13265:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788791625.884591:0:13265:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ababb82c000 x1875683630466944/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791627 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791625.884608:0:13265:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ababb82e300 x1875683630467456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791632 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791625.884624:0:13265:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ababb040a80 x1875683630467584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791637 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791625.884635:0:13265:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ababb042d80 x1875683630467840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791638 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791625.884649:0:13265:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788791625.884678:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875683630467840:0@lo:400:kworker.0 00000100:00080000:0.0:1788791625.884703:0:13265:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:1.0:1788791625.884791:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791625.884798:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322caa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322cb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791625.884806:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abaa1b5ca00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791625.884810:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322caa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322cb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791625.884818:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322caa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a322cb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791625.884824:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322caa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a322cb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791625.884830:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788791625.884832:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788791625.884834:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788791625.884846:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9aba850fe000 00010000:00010000:1.0:1788791625.884849:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322caa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a322cb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791625.884855:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5ca00/0xcd6380150a322caa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a322cb1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791625.884865:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791625.884866:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791625.884868:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788791625.884913:0:13265:0:(import.c:65:import_set_state_nolock()) ffff9abab3069800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788791625.885057:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875683630467968:0@lo:39:umount.0 00000400:00000100:1.0:1788791625.885103:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875683630467968 offset 0 length 224: 4 00000100:00100000:3.0:1788791625.885523:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630467456:0@lo:400:kworker.0 00000100:00100000:3.0:1788791625.885550:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875683630467584:0@lo:400:kworker.0 00000100:00100000:2.0:1788791625.885645:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630466944:0@lo:400:kworker.0 00010000:00010000:1.0:1788791626.420428:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791627.427402:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788791628.067312:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9967ad2d-016f-4163-8b2b-d5dc380f4403->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788791628.067331:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9967ad2d-016f-4163-8b2b-d5dc380f4403->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788791628.452667:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791629.476283:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791630.499366:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791631.525277:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791632.548250:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788791633.187485:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9967ad2d-016f-4163-8b2b-d5dc380f4403->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788791633.187494:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9967ad2d-016f-4163-8b2b-d5dc380f4403->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788791633.577643:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791634.596888:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791635.107284:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788791625/real 1788791625] req@ffff9ababb82d180 x1875683630467968/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788791635 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791635.107320:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ababb82d180 x1875683630467968/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788791635 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788791635.107339:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9abab3069800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788791635.107363:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875683630467968:0@lo:39:umount.0 00000100:00080000:0.0:1788791635.107527:0:13265:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788791635.107533:0:13265:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788791635.107539:0:13265:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788791635.108448:0:13265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c000/0xcd6380150a322cb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322cbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791635.108464:0:13265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c000/0xcd6380150a322cb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322cbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791635.108495:0:13265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c000/0xcd6380150a322cb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322cbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791635.108502:0:13265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c000/0xcd6380150a322cb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322cbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791635.108532:0:13265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791635.108541:0:13265:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322eef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a322ef6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791635.108548:0:13265:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322eef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a322ef6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791635.108555:0:13265:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322eef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322ef6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791635.108561:0:13265:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd6380150a322ef6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791635.108658:0:13265:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788791635.108664:0:13265:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788791635.108689:0:13265:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788791635.108694:0:13265:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788791635.108699:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788791635.108705:0:13265:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788791635.108709:0:13265:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9ababb06cd28) has no exports 00000020:00080000:0.0:1788791635.108734:0:13265:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9ababb06cd28) has no exports 00000020:01000000:0.0:1788791635.110384:0:13265:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9aba98ee0780 - data ffff9abab7d056c0/ffff9ababb9a7800 00000020:01000000:0.0:1788791635.110555:0:13265:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9ababbacce40 - data ffff9abaac998798/ffff9abaa00ab400 00010000:00010000:2.0:1788791635.111523:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788791635.111535:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c000/0xcd6380150a322cb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322cbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791635.111547:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abaa1b5c000 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791635.111551:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c000/0xcd6380150a322cb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322cbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791635.111563:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c000/0xcd6380150a322cb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a322cbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791635.111581:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c000/0xcd6380150a322cb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a322cbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791635.111588:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788791635.111590:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788791635.111594:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788791635.111610:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9aba850fe000 00010000:00010000:2.0:1788791635.111615:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c000/0xcd6380150a322cb8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a322cbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791635.111622:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5c000/0xcd6380150a322cb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a322cbf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791635.111635:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791635.111639:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322ef6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791635.111645:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abac2171400 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791635.111648:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322eef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd6380150a322ef6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791635.111654:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a322ef6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791635.111661:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322eef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a322ef6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791635.111666:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788791635.111669:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788791635.111677:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788791635.111683:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9aba850fe000 00010000:00010000:2.0:1788791635.111686:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322eef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a322ef6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791635.111693:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abac2171400/0xcd6380150a322eef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a322ef6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791635.111706:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791635.111708:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791635.111710:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791635.114849:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788791635.121093:0:13265:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788791635.143341:0:13265:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322bae 00000020:00000080:2.0:1788791635.143352:0:13265:0:(genops.c:885:class_export_put()) final put ffff9ababbc66000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788791635.143370:0:13265:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9ab9818e0800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788791635.143373:0:13265:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ab9818e0800 2 00000020:01000004:2.0:1788791635.143376:0:13265:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9ab9818e0800 from lustre-OST0001 00000020:00000080:2.0:1788791635.143405:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788791635.143417:0:13265:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788791635.143419:0:13265:0:(genops.c:885:class_export_put()) final put ffff9ab98126d800/lustre-OST0001_UUID 00000020:00000080:2.0:1788791635.143423:0:13265:0:(genops.c:844:class_export_destroy()) destroying export ffff9ab98126d800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788791635.143430:0:13265:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788791635.143527:0:13265:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 9967ad2d-016f-4163-8b2b-d5dc380f4403->MGS 00000020:00000080:1.0:1788791635.143652:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababbc66000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:2.0:1788791635.143690:0:13265:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d400/0xcd6380150a322ac0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a322ac7 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791635.143703:0:13265:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d400/0xcd6380150a322ac0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a322ac7 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791635.143709:0:13265:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788791635.143712:0:13265:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788791635.143715:0:13265:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788791635.143733:0:13265:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9aba850fe000 00010000:00010000:2.0:1788791635.143749:0:13265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abaa1b5d400/0xcd6380150a322ac0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a322ac7 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791635.143766:0:13265:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abac2171000/0xcd6380150a322cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd6380150a322d05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791635.143773:0:13265:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abac2171000/0xcd6380150a322cfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd6380150a322d05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791635.143778:0:13265:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788791635.143781:0:13265:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788791635.143783:0:13265:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788791635.143793:0:13265:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9aba850fe000 00010000:00010000:2.0:1788791635.143796:0:13265:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abac2171000/0xcd6380150a322cfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd6380150a322d05 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788791635.143813:0:13265:0:(import.c:65:import_set_state_nolock()) ffff9aba850fe000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788791635.143817:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788791635.143819:0:13265:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788791635.143821:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788791635.143825:0:13265:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788791635.143836:0:13265:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9ababb040380 x1875683630467712/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788791637 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788791635.143895:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788791635.143899:0:13265:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:1.0:1788791635.146842:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9967ad2d-016f-4163-8b2b-d5dc380f4403:3311:1875683630467712:0@lo:250:kworker.0 10000000:01000000:3.0:1788791635.146926:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788791635.146940:0:13265:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a3229a1 00000020:00000080:3.0:1788791635.146948:0:13265:0:(genops.c:885:class_export_put()) final put ffff9aba993ab800/9967ad2d-016f-4163-8b2b-d5dc380f4403 00000020:01000000:3.0:1788791635.146968:0:13265:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.129@tcp (flags='') 00000020:00000080:3.0:1788791635.146974:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788791635.146983:0:13265:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.129@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788791635.146987:0:13265:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9aba88c60000) has no exports 00000020:00000080:1.0:1788791635.147080:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba993ab800/9967ad2d-016f-4163-8b2b-d5dc380f4403 for MGC192.168.201.129@tcp 10000000:01000000:2.0:1788791635.147207:0:5834:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788791635.147311:0:13265:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.129@tcp: client import never connected 00000100:00080000:3.0:1788791635.147315:0:13265:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788791635.147318:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788791635.147322:0:13265:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788791635.147324:0:13265:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788791635.147365:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788791635.147371:0:13265:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.129@tcp (uuid 9967ad2d-016f-4163-8b2b-d5dc380f4403) 00000020:01000000:3.0:1788791635.147377:0:13265:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788791635.147381:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788791635.147384:0:13265:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788791635.147389:0:13265:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9abab3068800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788791635.147393:0:13265:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9abab3063370) has exports, disconnecting them 00000020:00080000:3.0:1788791635.147408:0:13265:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9abab3068800), last request at 1788791418 00000020:00000080:3.0:1788791635.147412:0:13265:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322bd8 00000020:00080000:3.0:1788791635.147422:0:13265:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9abab3068800): rc 0 00000020:00000080:3.0:1788791635.147426:0:13265:0:(genops.c:885:class_export_put()) final put ffff9abab3068800/lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788791635.148394:0:13265:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788791635.148400:0:13265:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788791635.148403:0:13265:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788791635.148409:0:13265:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788791635.148537:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788791635.148557:0:13265:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788791635.148570:0:13265:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9ab9818e0800 1 00000020:00000080:2.0:1788791635.148576:0:13265:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd6380150a322b7d 00000020:00000080:2.0:1788791635.148582:0:13265:0:(genops.c:885:class_export_put()) final put ffff9ababab12800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788791635.148586:0:13265:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788791635.148590:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788791635.148593:0:13265:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788791635.148596:0:13265:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9abab3e399b8) has no exports 00000020:00000080:1.0:1788791635.148744:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9aba850fe000 for MGC192.168.201.129@tcp 00000020:00000080:1.0:1788791635.148756:0:37:0:(genops.c:885:class_export_put()) final put ffff9aba850fb800/9967ad2d-016f-4163-8b2b-d5dc380f4403 00000020:00000080:1.0:1788791635.148758:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba850fb800/9967ad2d-016f-4163-8b2b-d5dc380f4403 for MGC192.168.201.129@tcp 00000020:01000000:1.0:1788791635.148764:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.129@tcp (9967ad2d-016f-4163-8b2b-d5dc380f4403) 00010000:00010000:2.0:1788791635.149069:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1788791635.152587:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1788791635.152904:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9aba997dc200:5820] 0 exiting: rc = 1 00000100:00100000:2.0:1788791635.153225:0:8451:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9ababbfd7a00:8451] 2 exiting: rc = 0 00000100:00100000:3.0:1788791635.154433:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9aba9ee2c800:5821] 1 exiting: rc = 0 00000100:00100000:1.0:1788791635.154640:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.154881:0:8452:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9abac04dde00:8452] 3 exiting: rc = 0 00000100:00100000:1.0:1788791635.154947:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9aba997ddc00:5824] 2 exiting: rc = 0 00000100:00100000:1.0:1788791635.155010:0:12870:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9abab305d600:12870] 4 exiting: rc = 0 00000100:00100000:3.0:1788791635.155113:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9aba997dd800:5823] 1 exiting: rc = 0 00000100:00100000:2.0:1788791635.155324:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9aba997dce00:5822] 0 exiting: rc = 1 00000100:00100000:1.0:1788791635.155564:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155574:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155580:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155587:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155593:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155598:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155604:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155617:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155624:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155630:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155635:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155642:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155647:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155653:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155659:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155665:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155671:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155677:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155682:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155687:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155691:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155696:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155702:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155707:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155712:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155717:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155722:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155727:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155732:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155737:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155741:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155747:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155763:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155768:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155774:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155779:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155784:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155789:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155794:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155799:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155803:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155807:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155813:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155818:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155825:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155830:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155834:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155840:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155845:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155850:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155855:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155860:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155865:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155870:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155875:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155880:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155885:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155889:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155894:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155898:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155903:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155909:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155915:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.155919:0:37:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788791635.156804:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9abab3068800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788791635.156814:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9abab3069800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788791635.156820:0:37:0:(genops.c:885:class_export_put()) final put ffff9ababefd4800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788791635.156830:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababefd4800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788791635.156833:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788791635.156865:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababab12800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788791635.171184:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788791635.171199:0:13265:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788791635.171205:0:13265:0:(genops.c:885:class_export_put()) final put ffff9ababefd6000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788791635.171210:0:13265:0:(genops.c:844:class_export_destroy()) destroying export ffff9ababefd6000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788791635.171221:0:13265:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788791635.171469:0:13265:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9ababefd5000 00000020:01000000:2.0:1788791635.171491:0:13265:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788791635.171496:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788791635.171501:0:13265:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788791635.171506:0:13265:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9aba980619b8) has no exports 00000020:00000080:2.0:1788791635.171539:0:13265:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788791635.171558:0:13265:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788791635.171561:0:13265:0:(genops.c:885:class_export_put()) final put ffff9aba993f5000/OSS_uuid 00000020:00000080:2.0:1788791635.171563:0:13265:0:(genops.c:844:class_export_destroy()) destroying export ffff9aba993f5000/OSS_uuid for OSS 00000020:01000000:2.0:1788791635.171567:0:13265:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788791635.172590:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9ababbce2800:6682] 1 exiting: rc = 0 00000100:00100000:2.0:1788791635.172674:0:10087:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9ababbf0a600:10087] 3 exiting: rc = 0 00000100:00100000:3.0:1788791635.176860:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9aba866f1200:6681] 0 exiting: rc = 1 00000100:00080000:0.0:1788791635.177261:0:5833:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788791635.177387:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9ababbce3000:6683] 2 exiting: rc = 0 00000100:00100000:0.0:1788791635.177446:0:12011:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9aba862dfe00:12011] 4 exiting: rc = 0 00000100:00100000:2.0:1788791635.178567:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178577:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178583:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178589:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178608:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178613:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178618:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178623:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178628:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178632:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178638:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178643:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178649:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178654:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178660:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178665:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178669:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178674:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178679:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178683:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178688:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178693:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178698:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178703:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178709:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178714:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178719:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178724:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178728:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178734:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178739:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178744:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178749:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178754:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178759:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178764:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178769:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178774:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178779:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178792:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178797:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178801:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178810:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178817:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178823:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178827:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178833:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178838:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178843:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178848:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178853:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178859:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178864:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178869:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178874:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178880:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178885:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178889:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178894:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178900:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178905:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178910:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178915:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.178920:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788791635.186805:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9aba8570ee00:6684] 0 exiting: rc = 1 00000100:00100000:0.0:1788791635.186913:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9abab2c14000:6685] 1 exiting: rc = 0 00000100:00100000:2.0:1788791635.187293:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187303:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187309:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187314:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187319:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187325:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187330:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187335:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187341:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187346:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187364:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187369:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187374:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187379:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187384:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187389:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187394:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187400:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187406:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187411:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187415:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187420:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187424:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187430:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187435:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187440:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187445:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187449:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187454:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187458:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187463:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187468:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187473:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187479:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187484:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187489:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187494:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187499:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187503:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187509:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187514:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187519:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187524:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187530:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.187535:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188595:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188603:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188608:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188613:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188619:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188652:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188661:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188667:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188672:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188677:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188683:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188688:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188695:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188700:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188705:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188710:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188715:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188721:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.188726:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788791635.190104:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9aba8570e400:6686] 0 exiting: rc = 1 00000100:00100000:3.0:1788791635.195624:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9aba8570f600:6687] 1 exiting: rc = 0 00000100:00100000:0.0:1788791635.200339:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9aba8570f000:6688] 2 exiting: rc = 0 00000100:00100000:1.0:1788791635.210290:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210300:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210306:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210312:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210317:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210332:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210339:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210345:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210359:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210365:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210372:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210377:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210383:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210388:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210407:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210415:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210420:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210426:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210431:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210437:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210443:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210448:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210454:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210460:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210465:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210471:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210476:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210483:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210489:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210494:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210499:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210515:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210521:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210526:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210532:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210539:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210544:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210550:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210568:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210575:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210581:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210586:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210592:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210597:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210603:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210609:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210615:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210622:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210628:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210634:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210639:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210645:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210651:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210658:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210664:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210672:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210677:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210683:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210688:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210695:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210700:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210706:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210713:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.210728:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221322:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9aba8570fe00:6689] 0 exiting: rc = 1 00000100:00100000:1.0:1788791635.221601:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9aba85635400:6690] 1 exiting: rc = 0 00000100:00100000:1.0:1788791635.221664:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221671:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221676:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221682:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221687:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221692:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221697:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221702:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221707:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221712:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221801:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221808:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221813:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221819:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221823:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221828:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221832:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221836:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221842:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221846:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221851:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221857:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221862:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221867:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221882:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221889:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221896:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221901:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221968:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221973:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221979:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221984:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221989:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221994:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.221999:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222010:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222015:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222020:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222026:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222031:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222036:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222041:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222046:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222051:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222056:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222061:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222066:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222071:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222076:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222081:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222086:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222091:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222095:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222100:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222105:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222110:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222115:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222120:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222150:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222157:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222163:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222168:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222173:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.222184:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.223584:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9abac0606a00:6691] 0 exiting: rc = 1 00000100:00100000:2.0:1788791635.223797:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9abac0607c00:6692] 1 exiting: rc = 0 00000100:00100000:1.0:1788791635.224120:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224170:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224177:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224183:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224188:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224216:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224223:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224238:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224245:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224251:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224258:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224264:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224270:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224276:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224283:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224288:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224295:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224319:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224327:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224334:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224340:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224347:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224552:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224559:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224564:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224570:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224575:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224581:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224588:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224615:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224623:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224629:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224636:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224642:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224647:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224654:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224666:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224674:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224680:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224687:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224700:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224925:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224934:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224940:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224946:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224953:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224958:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224965:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224971:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224986:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.224994:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.225007:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.225015:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.225021:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.225027:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.225033:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.225054:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.225062:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.225067:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.225073:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.225079:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.225085:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.225092:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788791635.225098:0:13265:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788791635.242433:0:13265:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788791653.402362:0:13882:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788791663.653260:0:14343:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788791663.653265:0:14343:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788791663.654040:0:14343:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9aba89374800 00000020:01000004:2.0:1788791663.654065:0:14343:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788791663.654072:0:14343:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788791663.654086:0:14343:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9abab30619b8) 00000020:00000080:2.0:1788791663.654098:0:14343:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788791663.679695:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788791663.684686:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1788791663.685642:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788791663.685705:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 397: rc = 0 00100000:10000000:0.0:1788791663.685943:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 397: rc = 0 00100000:10000000:0.0:1788791663.686104:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 397: rc = 0 00100000:10000000:0.0:1788791663.686562:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 397: rc = 0 00100000:10000000:0.0:1788791663.686654:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 397: rc = 0 00100000:10000000:0.0:1788791663.686752:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 397: rc = 0 00100000:10000000:0.0:1788791663.687248:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 399: rc = 0 00100000:10000000:0.0:1788791663.689210:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 97: rc = 0 00100000:10000000:0.0:1788791663.689548:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 97: rc = 0 00100000:10000000:0.0:1788791663.690115:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 102: rc = 0 00100000:10000000:0.0:1788791663.690572:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 102: rc = 0 00100000:10000000:0.0:1788791663.691200:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 102: rc = 0 00100000:10000000:0.0:1788791663.691684:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 102: rc = 0 00100000:10000000:0.0:1788791663.692024:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 102: rc = 0 00100000:10000000:0.0:1788791663.692741:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 102: rc = 0 00100000:10000000:0.0:1788791663.693205:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 102: rc = 0 00100000:10000000:0.0:1788791663.693688:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 102: rc = 0 00100000:10000000:0.0:1788791663.694021:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 102: rc = 0 00100000:10000000:0.0:1788791663.694656:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 102: rc = 0 00100000:10000000:0.0:1788791663.695008:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 102: rc = 0 00100000:10000000:0.0:1788791663.695533:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 102: rc = 0 00100000:10000000:0.0:1788791663.696690:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 127: rc = 0 00100000:10000000:0.0:1788791663.697035:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 127: rc = 0 00100000:10000000:0.0:1788791663.697682:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 127: rc = 0 00100000:10000000:0.0:1788791663.698031:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 127: rc = 0 00100000:10000000:0.0:1788791663.698621:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 127: rc = 0 00100000:10000000:0.0:1788791663.698911:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 127: rc = 0 00100000:10000000:0.0:1788791663.699282:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 127: rc = 0 00100000:10000000:0.0:1788791663.699710:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 127: rc = 0 00100000:10000000:0.0:1788791663.700031:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 127: rc = 0 00100000:10000000:0.0:1788791663.701037:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 127: rc = 0 00100000:10000000:0.0:1788791663.701727:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 127: rc = 0 00100000:10000000:0.0:1788791663.702617:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 127: rc = 0 00100000:10000000:0.0:1788791663.702960:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 127: rc = 0 00100000:10000000:0.0:1788791663.703658:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 127: rc = 0 00100000:10000000:0.0:1788791663.704647:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 127: rc = 0 00100000:10000000:0.0:1788791663.705558:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 127: rc = 0 00100000:10000000:0.0:1788791663.708576:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 127: rc = 0 00100000:10000000:0.0:1788791663.708888:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 127: rc = 0 00100000:10000000:0.0:1788791663.709192:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 127: rc = 0 00100000:10000000:0.0:1788791663.711605:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 127: rc = 0 00100000:10000000:0.0:1788791663.712603:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 127: rc = 0 00100000:10000000:0.0:1788791663.712872:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 127: rc = 0 00100000:10000000:0.0:1788791663.713120:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 127: rc = 0 00100000:10000000:0.0:1788791663.713415:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 127: rc = 0 00100000:10000000:0.0:1788791663.713662:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 127: rc = 0 00100000:10000000:0.0:1788791663.713933:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 127: rc = 0 00100000:10000000:0.0:1788791663.714212:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 127: rc = 0 00100000:10000000:0.0:1788791663.714469:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 127: rc = 0 00100000:10000000:0.0:1788791663.714702:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 127: rc = 0 00100000:10000000:0.0:1788791663.714932:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 127: rc = 0 00100000:10000000:0.0:1788791663.715193:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 127: rc = 0 00100000:10000000:0.0:1788791663.715447:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 127: rc = 0 00100000:10000000:2.0:1788791663.720787:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 116: rc = 0 00100000:10000000:2.0:1788791663.724525:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788791663.724739:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 98: rc = 0 00100000:10000000:2.0:1788791663.725235:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788791663.725495:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 98: rc = 0 00100000:10000000:2.0:1788791663.725692:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788791663.725775:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 98: rc = 0 00100000:10000000:2.0:1788791663.726565:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788791663.726645:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 606: rc = 0 00100000:10000000:2.0:1788791663.726989:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788791663.727243:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 606: rc = 0 00100000:10000000:2.0:1788791663.727633:0:14343:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788791663.727709:0:14343:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 606: rc = 0 00000020:00000080:2.0:1788791663.728245:0:14343:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788791663.728253:0:14343:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788791663.728262:0:14343:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a323ca2 00000020:01000004:2.0:1788791663.728271:0:14343:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788791663.728275:0:14343:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788791663.728280:0:14343:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9aba89374800 from MGS 00000020:01000004:2.0:1788791663.728284:0:14343:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788791663.728294:0:14343:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9abab3060000) 00000020:00000080:2.0:1788791663.728487:0:14343:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788791663.728545:0:14343:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9aba89374800 from MGS, refs=2 00080000:01000000:2.0:1788791663.728550:0:14343:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788791663.728556:0:14343:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a323cb0 00000100:00100000:2.0:1788791663.728650:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788791663.728793:0:14343:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788791663.728799:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788791663.730119:0:14343:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788791663.730244:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788791663.731725:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788791663.732117:0:14343:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788791663.732217:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788791663.733247:0:14343:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788791663.733257:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788791663.733727:0:14343:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788791663.733742:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788791663.734800:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791663.734804:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791663.734806:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791663.735577:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791663.735580:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791663.735583:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791663.736227:0:14343:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788791663.737423:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788791663.756536:0:14343:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788791663.756555:0:14343:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788791663.756566:0:14343:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788791663.762792:0:14352:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788791663.763065:0:14343:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788791663.764006:0:14343:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788791663.764590:0:14343:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788791663.765450:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788791663.765613:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788791663.765619:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788791663.771488:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788791663.771504:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788791663.772940:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788791663.772948:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788791663.774522:0:14343:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788791663.774544:0:14343:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.129@tcp' 00000020:01000004:3.0:1788791663.774546:0:14343:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788791663.774574:0:14343:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.129@tcp (typ=mgc) 00000020:00000080:3.0:1788791663.774587:0:14343:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.129@tcp (ffff9abab3e38000) 00000020:00000080:3.0:1788791663.774602:0:14343:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788791663.774674:0:14343:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ab9819fa800@MGC192.168.201.129@tcp: add connection 192.168.201.129@tcp at head 00010000:00010000:3.0:1788791663.774829:0:14343:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.129@tcp-0 is initialized 00000040:01000000:3.0:1788791663.774835:0:14343:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788791663.775542:0:14358:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788791663.775712:0:14343:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.129@tcp (uuid aa113159-ee5b-4f24-93ba-c8c094c83d87) 00000020:00000080:2.0:1788791663.775737:0:14343:0:(genops.c:1385:class_connect()) connect: client aa113159-ee5b-4f24-93ba-c8c094c83d87, cookie 0xcd6380150a323cbe 00000100:00080000:2.0:1788791663.775746:0:14343:0:(import.c:510:import_select_connection()) MGC192.168.201.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788791663.775752:0:14343:0:(import.c:624:import_select_connection()) MGC192.168.201.129@tcp: import ffff9ab9819fa800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788791663.775782:0:14343:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ababb041c00 x1875683630468096/t0(0) o250->MGC192.168.201.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788791663.775812:0:14343:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import aa113159-ee5b-4f24-93ba-c8c094c83d87->MGS 00000020:01000004:2.0:1788791663.775830:0:14343:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788791663.775835:0:14343:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788791663.775847:0:14343:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9abab3064d28) 00000020:00000080:2.0:1788791663.775857:0:14343:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1788791663.776009:0:14357:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1788791663.776165:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aa113159-ee5b-4f24-93ba-c8c094c83d87:3311:1875683630468096:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788791663.776227:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791663.776355:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630468096 00000100:00100000:1.0:1788791663.776362:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630468096 00000100:00100000:1.0:1788791663.776403:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788791663.776410:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3311:x1875683630468096:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788791663.776430:0:14354:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from aa113159-ee5b-4f24-93ba-c8c094c83d87@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:1.0:1788791663.776451:0:14354:0:(genops.c:1385:class_connect()) connect: client aa113159-ee5b-4f24-93ba-c8c094c83d87, cookie 0xcd6380150a323ccc 00000100:00080000:1.0:1788791663.776567:0:14354:0:(import.c:65:import_set_state_nolock()) ffff9aba88221000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788791663.776629:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+5:3311:x1875683630468096:12345-0@lo:250:mount.lustre.0 Request processed in 218us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791663.776637:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788791663.776797:0:3311:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788791663.776804:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.129@tcp: connect to target with instance 0 00000100:00080000:3.0:1788791663.776810:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788791663.776814:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788791663.776817:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ab9819fa800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788791663.776820:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788791663.776828:0:3311:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788791663.776833:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:aa113159-ee5b-4f24-93ba-c8c094c83d87:3311:1875683630468096:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788791663.798245:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788791663.798440:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788791663.798446:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788791663.806016:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788791663.806029:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788791663.806614:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788791663.806620:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788791663.807259:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788791663.807585:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788791663.807591:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788791663.808987:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788791663.808999:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788791663.857594:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788791663.857802:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788791663.857809:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788791663.859800:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788791663.859811:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788791663.860400:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788791663.860578:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788791663.860583:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788791663.861745:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788791663.861755:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788791663.862317:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788791663.862459:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788791663.862464:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788791663.862959:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788791663.862966:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788791663.863573:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788791663.863700:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788791663.863704:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788791663.864116:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788791663.864122:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788791663.896805:0:14343:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788791663.897001:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788791663.899977:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788791663.901744:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788791663.901757:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788791663.902709:0:14343:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788791663.902719:0:14343:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788791663.903878:0:14343:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788791663.903912:0:14343:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788791663.903919:0:14343:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788791663.904203:0:14343:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788791663.904236:0:14343:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788791663.904241:0:14343:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788791663.904243:0:14343:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788791663.904244:0:14343:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788791663.904245:0:14343:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788791663.904246:0:14343:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788791663.904247:0:14343:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788791663.904248:0:14343:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788791663.904250:0:14343:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788791663.904252:0:14343:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788791663.904253:0:14343:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788791663.904256:0:14343:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788791663.904258:0:14343:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788791663.904259:0:14343:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788791663.904260:0:14343:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788791663.904261:0:14343:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788791663.904262:0:14343:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788791663.904263:0:14343:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788791663.904264:0:14343:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788791663.904265:0:14343:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788791663.904266:0:14343:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788791663.904267:0:14343:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788791663.904302:0:14343:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788791663.904322:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630468224:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788791663.904392:0:14343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791663.904498:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba82b68840 going to sleep for 11 seconds 00000100:00100000:1.0:1788791663.912196:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630468224 00000100:00100000:1.0:1788791663.912212:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630468224 00000100:00100000:1.0:1788791663.912266:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788791663.912276:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+5:14343:x1875683630468224:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788791663.912337:0:14356:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788791663.912341:0:14356:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788791663.912344:0:14356:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788791663.913295:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788791663.913742:0:14356:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788791663.915397:0:14378:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788791663.915405:0:14378:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788791663.915407:0:14378:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788791663.915440:0:14378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1788791663.915773:0:14356:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788791663.915782:0:14356:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788791663.931505:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+5:14343:x1875683630468224:12345-0@lo:253:mount.lustre.0 Request processed in 19223us (27105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791663.931524:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788791663.931625:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630468224:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788791663.931658:0:14343:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788791663.931662:0:14343:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788791663.931664:0:14343:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788791663.931665:0:14343:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788791663.931667:0:14343:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788791663.931668:0:14343:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788791663.931669:0:14343:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788791663.931671:0:14343:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788791663.931672:0:14343:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788791663.931674:0:14343:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788791663.931675:0:14343:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788791663.931694:0:14343:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9aba89374800 from lustre-MDT0000 10000000:01000000:3.0:1788791663.931718:0:14343:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788791663.931721:0:14343:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788791663.931736:0:14343:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9abab3e38000 10000000:01000000:3.0:1788791663.931741:0:14343:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788791663.931749:0:14343:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9abab3e38000 from 1 10000000:01000000:3.0:1788791663.931752:0:14343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788791663.931786:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c800/0xcd6380150a323cd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791663.931797:0:14343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb16c800/0xcd6380150a323cd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791663.931807:0:14343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb16c800/0xcd6380150a323cd3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791663.931826:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630468352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788791663.931864:0:14343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791663.931901:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd480 going to sleep for 11 seconds 00000100:00100000:1.0:1788791663.931955:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630468352 00000100:00100000:1.0:1788791663.931961:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630468352 00000100:00100000:1.0:1788791663.932003:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788791663.932013:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+5:14343:x1875683630468352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788791663.932025:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791663.932050:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abab2c00400/0xcd6380150a323cda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a323cd3 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791663.932072:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abab2c00400/0xcd6380150a323cda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a323cd3 expref: 6 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791663.932089:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abab2c00400/0xcd6380150a323cda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323cd3 expref: 6 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791663.932098:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c00400, rc 0) 00000100:00100000:1.0:1788791663.932159:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+6:14343:x1875683630468352:12345-0@lo:101:mount.lustre.0 Request processed in 148us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791663.932164:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788791663.932432:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630468352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788791663.932444:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb16c800/0xcd6380150a323cd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323cda expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791663.932460:0:14343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb16c800/0xcd6380150a323cd3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323cda expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791663.932506:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630468480:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791663.932533:0:14343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791663.932557:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788791663.932615:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630468480 00000100:00100000:0.0:1788791663.932620:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630468480 00000100:00100000:0.0:1788791663.932657:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788791663.932664:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+6:14343:x1875683630468480:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791663.932876:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+6:14343:x1875683630468480:12345-0@lo:501:mount.lustre.0 Request processed in 212us (341us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788791663.932883:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788791663.932957:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630468480:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788791663.932978:0:14343:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788791663.932993:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c800/0xcd6380150a323cd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323cda expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791663.933001:0:14343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb16c800/0xcd6380150a323cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323cda expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791663.933018:0:14343:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9aba89374800 10000000:01000000:3.0:1788791663.933022:0:14343:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788791663.933026:0:14343:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9aba89374800 10000000:01000000:3.0:1788791663.933028:0:14343:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788791663.933031:0:14343:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9aba89374800 from 1 10000000:01000000:3.0:1788791663.933033:0:14343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788791663.933055:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791663.933063:0:14343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791663.933071:0:14343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791663.933089:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630468608:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788791663.933115:0:14343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791663.933156:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788791663.933307:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630468608 00000100:00100000:0.0:1788791663.933312:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630468608 00000100:00100000:0.0:1788791663.933344:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788791663.933350:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+6:14343:x1875683630468608:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788791663.933358:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791663.933368:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994ffc00/0xcd6380150a323ce8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a323ce1 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791663.933394:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ffc00/0xcd6380150a323ce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a323ce1 expref: 7 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791663.933403:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994ffc00/0xcd6380150a323ce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323ce1 expref: 7 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791663.933409:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ffc00, rc 0) 00000100:00100000:0.0:1788791663.933435:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+7:14343:x1875683630468608:12345-0@lo:101:mount.lustre.0 Request processed in 86us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791663.933441:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788791663.933632:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630468608:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788791663.933643:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323ce8 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791663.933651:0:14343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323ce8 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791663.933661:0:14343:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788791663.933667:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323ce8 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791663.933674:0:14343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb16ce00/0xcd6380150a323ce1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323ce8 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791663.933680:0:14343:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788791663.933684:0:14343:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788791663.933688:0:14343:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9aba89374800 10000000:01000000:3.0:1788791663.933691:0:14343:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788791663.933694:0:14343:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788791663.933696:0:14343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788791663.933709:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791663.933716:0:14343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791663.933742:0:14343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791663.933754:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630468736:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788791663.933781:0:14343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791663.933846:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd480 going to sleep for 11 seconds 00000100:00100000:1.0:1788791663.937394:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630468736 00000100:00100000:1.0:1788791663.937409:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630468736 00000100:00100000:1.0:1788791663.937462:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788791663.937472:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+7:14343:x1875683630468736:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788791663.937489:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791663.937505:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abab2c00800/0xcd6380150a323cf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a323cef expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791663.937530:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abab2c00800/0xcd6380150a323cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a323cef expref: 8 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791663.937541:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abab2c00800/0xcd6380150a323cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323cef expref: 8 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791663.937550:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c00800, rc 0) 00000100:00100000:1.0:1788791663.937925:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+8:14343:x1875683630468736:12345-0@lo:101:mount.lustre.0 Request processed in 453us (4141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791663.937933:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788791663.942439:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630468736:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788791663.942466:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323cf6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791663.942478:0:14343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323cf6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791663.942556:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630468864:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791663.942611:0:14343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791663.942718:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788791663.945363:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630468864 00000100:00100000:0.0:1788791663.945378:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630468864 00000100:00100000:0.0:1788791663.945436:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788791663.945447:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+8:14343:x1875683630468864:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791663.945947:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+9:14343:x1875683630468864:12345-0@lo:501:mount.lustre.0 Request processed in 500us (3333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791663.945956:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788791663.950270:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630468864:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791663.950337:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630468992:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788791663.950414:0:14343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791663.950459:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd480 going to sleep for 11 seconds 00000100:00100000:1.0:1788791663.950549:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630468992 00000100:00100000:1.0:1788791663.950556:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630468992 00000100:00100000:1.0:1788791663.950603:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788791663.950611:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+9:14343:x1875683630468992:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788791663.950961:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+9:14343:x1875683630468992:12345-0@lo:503:mount.lustre.0 Request processed in 349us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791663.950969:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788791663.951256:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630468992:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788791663.951621:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa113159-ee5b-4f24-93ba-c8c094c83d87:14379:1875683630469120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788791663.951661:0:14379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791663.951692:0:14379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788791663.951758:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630469120 00000100:00100000:2.0:1788791663.951765:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630469120 00000100:00100000:2.0:1788791663.951802:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788791663.951812:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+9:14379:x1875683630469120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788791663.952079:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+9:14379:x1875683630469120:12345-0@lo:502:llog_process_th.0 Request processed in 269us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791663.952086:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788791663.952499:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa113159-ee5b-4f24-93ba-c8c094c83d87:14379:1875683630469120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788791663.952526:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791663.952537:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791663.952539:0:14379:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788791663.952544:0:14379:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788791663.952547:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788791663.952560:0:14379:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9abab3e3cd28) 00000020:00000080:3.0:1788791663.952576:0:14379:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788791663.952582:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788791663.952653:0:14379:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788791663.952660:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a323d04 00000020:00000080:3.0:1788791663.952889:0:14379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788791663.952894:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791663.952897:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791663.952899:0:14379:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788791663.952901:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791663.952905:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791663.952906:0:14379:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788791663.952909:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788791663.952916:0:14379:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9abab3e3b370) 00000020:00000080:3.0:1788791663.952925:0:14379:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788791663.952929:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788791663.952930:0:14379:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788791663.952933:0:14379:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788791663.952938:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788791663.952987:0:14379:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9aba89374800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788791663.953000:0:14379:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9abab3e399b8) 00000020:00000080:3.0:1788791663.958195:0:14379:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788791663.958301:0:14379:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788791663.958312:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd6380150a323d19 00000020:00000080:3.0:1788791663.958447:0:14379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788791663.958455:0:14379:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788791663.958471:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcd6380150a323d20 00080000:01000000:3.0:1788791663.958478:0:14379:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788791663.958483:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a323d27 00010000:00010000:2.0:1788791664.106688:0:14379:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788791664.107155:0:14379:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788791664.107332:0:14379:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788791664.114855:0:14379:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9abab3063370) 00000020:00000080:2.0:1788791664.114878:0:14379:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788791664.114979:0:14379:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788791664.114987:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a323d35 00000020:00000080:2.0:1788791664.120422:0:14379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788791664.128024:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcd6380150a323d3c 00000020:00000080:2.0:1788791664.130939:0:14379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788791664.130954:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788791664.130963:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791664.130965:0:14379:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788791664.130970:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788791664.130972:0:14379:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788791664.130974:0:14379:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788791664.130976:0:14379:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788791664.130977:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788791664.130980:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791664.130981:0:14379:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788791664.130983:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788791664.130988:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791664.130989:0:14379:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788791664.130995:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788791664.131055:0:14379:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788791664.131072:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788791664.131076:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791664.131077:0:14379:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788791664.131080:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788791664.131084:0:14379:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788791664.131088:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791664.131089:0:14379:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788791664.131093:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788791664.131098:0:14379:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:2.0:1788791664.131148:0:14379:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788791664.131153:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788791664.131169:0:14379:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9ababc1499b8) 00000020:00000080:2.0:1788791664.131189:0:14379:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788791664.131194:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788791664.131252:0:14379:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788791664.131258:0:14379:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788791664.131266:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a323d4a 00010000:00080000:2.0:1788791664.131299:0:14379:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9abab306e800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1788791664.131519:0:14379:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788791664.131960:0:14379:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788791664.132000:0:14379:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788791664.132904:0:14379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788791664.132977:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788791664.133047:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788791664.136214:0:14383:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788791664.136221:0:14383:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788791664.148196:0:14379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788791664.148212:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788791664.148244:0:14379:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788791664.148263:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd6380150a323d51 00000100:00080000:2.0:1788791664.148273:0:14379:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788791664.148280:0:14379:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9abab306e800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788791664.148322:0:14379:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ababb041f80 x1875683630469248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788791664.148350:0:14379:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788791664.148402:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788791664.148406:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791664.148408:0:14379:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788791664.148412:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788791664.148414:0:14379:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788791664.148415:0:14379:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788791664.148417:0:14379:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788791664.148418:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788791664.148421:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791664.148422:0:14379:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788791664.148424:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788791664.148428:0:14379:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788791664.148431:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791664.148433:0:14379:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788791664.148436:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788791664.148440:0:14379:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.129@tcp to nid 0x20000c0a8c981 (192.168.201.129@tcp) 00000020:01000000:2.0:1788791664.148463:0:14379:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788791664.148466:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788791664.148477:0:14379:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9ababc14b370) 00000020:00000080:2.0:1788791664.148488:0:14379:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788791664.148492:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788791664.148544:0:14379:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788791664.148550:0:14379:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788791664.148555:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd6380150a323d5f 00010000:00080000:2.0:1788791664.148594:0:14379:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ababab12800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1788791664.148809:0:14379:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788791664.149024:0:14379:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788791664.149046:0:14379:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788791664.149806:0:14379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788791664.149891:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788791664.149964:0:14379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1788791664.150756:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630469248:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788791664.150813:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683630469248 offset 0 length 520: 4 00000040:00080000:1.0:1788791664.157392:0:14385:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788791664.157401:0:14385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788791664.163781:0:14379:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788791664.163800:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788791664.163855:0:14379:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788791664.163876:0:14379:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd6380150a323d66 00000100:00080000:0.0:1788791664.163888:0:14379:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788791664.163893:0:14379:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ababab12800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1788791664.163930:0:14379:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ababb82dc00 x1875683630469376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788791664.163962:0:14379:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788791664.164099:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791664.164104:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791664.164106:0:14379:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788791664.164109:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791664.164113:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791664.164114:0:14379:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788791664.164117:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788791664.164119:0:14379:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788791664.164121:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791664.164124:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791664.164151:0:14379:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788791664.164155:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791664.164158:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791664.164160:0:14379:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788791664.164164:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788791664.164198:0:14379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa113159-ee5b-4f24-93ba-c8c094c83d87:14379:1875683630469504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788791664.164280:0:14379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791664.164322:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630469504 00000100:00100000:0.0:1788791664.164328:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630469504 00000100:00100000:0.0:1788791664.164366:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788791664.164375:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+9:14379:x1875683630469504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788791664.164612:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+9:14379:x1875683630469504:12345-0@lo:502:llog_process_th.0 Request processed in 237us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791664.164620:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788791664.164669:0:14379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab2f62480 going to sleep for 11 seconds 00000100:00100000:0.0:1788791664.164691:0:14379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa113159-ee5b-4f24-93ba-c8c094c83d87:14379:1875683630469504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788791664.164715:0:14379:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791664.164719:0:14379:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791664.164732:0:14379:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788791664.164737:0:14379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788791664.164861:0:14343:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788791664.164878:0:14343:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788791664.164892:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323cf6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791664.164903:0:14343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb16da00/0xcd6380150a323cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323cf6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791664.164911:0:14343:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9aba89374800 from 1 10000000:01000000:0.0:1788791664.164914:0:14343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788791664.164940:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994ff000/0xcd6380150a323d6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791664.164948:0:14343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994ff000/0xcd6380150a323d6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791664.164957:0:14343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994ff000/0xcd6380150a323d6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791664.164971:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630469632:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788791664.164999:0:14343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791664.165012:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab2f62480 going to sleep for 11 seconds 00000100:00100000:0.0:1788791664.165035:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630469632 00000100:00100000:0.0:1788791664.165039:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630469632 00000100:00100000:0.0:1788791664.165061:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788791664.165068:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+9:14343:x1875683630469632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788791664.165076:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791664.165088:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba994ff200/0xcd6380150a323d74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a323d6d expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791664.165120:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ff200/0xcd6380150a323d74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a323d6d expref: 10 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791664.165166:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba994ff200/0xcd6380150a323d74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323d6d expref: 10 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791664.165176:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff200, rc 0) 00000100:00100000:0.0:1788791664.165207:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+10:14343:x1875683630469632:12345-0@lo:101:mount.lustre.0 Request processed in 139us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791664.165213:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788791664.165252:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630469632:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788791664.165263:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994ff000/0xcd6380150a323d6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323d74 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791664.165271:0:14343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994ff000/0xcd6380150a323d6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323d74 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791664.165778:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630469760:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788791664.165809:0:14343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791664.165831:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab2f62480 going to sleep for 11 seconds 00000100:00100000:0.0:1788791664.165843:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630469760 00000100:00100000:0.0:1788791664.165847:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630469760 00000100:00100000:0.0:1788791664.165866:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788791664.165870:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+10:14343:x1875683630469760:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788791664.165883:0:14355:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788791664.165888:0:14355:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788791664.165953:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+10:14343:x1875683630469760:12345-0@lo:256:mount.lustre.0 Request processed in 81us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791664.165960:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788791664.165994:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630469760:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788791664.166571:0:14343:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788791664.166586:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994ff000/0xcd6380150a323d6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323d74 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791664.166594:0:14343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994ff000/0xcd6380150a323d6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323d74 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791664.166601:0:14343:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9aba89374800 from 1 10000000:01000000:0.0:1788791664.166604:0:14343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788791664.166622:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a323d7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791664.166630:0:14343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a323d7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791664.166638:0:14343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a323d7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791664.166650:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630469888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788791664.166676:0:14343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791664.166696:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab2f62480 going to sleep for 11 seconds 00000100:00100000:0.0:1788791664.166714:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630469888 00000100:00100000:0.0:1788791664.166719:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630469888 00000100:00100000:3.0:1788791664.167106:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630469376:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788791664.167177:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683630469376 offset 0 length 520: 4 00000100:00100000:1.0:1788791664.175248:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788791664.175262:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+10:14343:x1875683630469888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788791664.175279:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791664.175300:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abab2c01800/0xcd6380150a323d82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a323d7b expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791664.175330:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abab2c01800/0xcd6380150a323d82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a323d7b expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791664.175340:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abab2c01800/0xcd6380150a323d82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323d7b expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791664.175350:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c01800, rc 0) 00000100:00100000:1.0:1788791664.175438:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+11:14343:x1875683630469888:12345-0@lo:101:mount.lustre.0 Request processed in 179us (8759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791664.175445:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788791664.175567:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630469888:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788791664.175588:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a323d7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323d82 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791664.175597:0:14343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a323d7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323d82 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791664.175678:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630470016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791664.175716:0:14343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791664.175761:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791664.175851:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630470016 00000100:00100000:1.0:1788791664.175858:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630470016 00000100:00100000:1.0:1788791664.175898:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788791664.175906:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+11:14343:x1875683630470016:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788791664.176296:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+11:14343:x1875683630470016:12345-0@lo:501:mount.lustre.0 Request processed in 390us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791664.176310:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788791664.176712:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630470016:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791664.176760:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630470144:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788791664.176802:0:14343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791664.176832:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791664.177059:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630470144 00000100:00100000:0.0:1788791664.177065:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630470144 00000100:00100000:0.0:1788791664.177097:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788791664.177111:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+11:14343:x1875683630470144:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788791664.177287:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+11:14343:x1875683630470144:12345-0@lo:503:mount.lustre.0 Request processed in 176us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791664.177294:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788791664.177415:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630470144:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788791664.177771:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa113159-ee5b-4f24-93ba-c8c094c83d87:14387:1875683630470272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788791664.177810:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791664.177836:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd240 going to sleep for 11 seconds 00000100:00100000:0.0:1788791664.177981:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630470272 00000100:00100000:0.0:1788791664.177986:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630470272 00000100:00100000:0.0:1788791664.178049:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788791664.178056:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+11:14387:x1875683630470272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788791664.178256:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+11:14387:x1875683630470272:12345-0@lo:502:llog_process_th.0 Request processed in 199us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791664.178262:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788791664.181254:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa113159-ee5b-4f24-93ba-c8c094c83d87:14387:1875683630470272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788791664.181304:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791664.181318:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791664.181320:0:14387:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788791664.181328:0:14387:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9aba89374800 00000020:00000080:3.0:1788791664.181331:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788791664.181339:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791664.181341:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791664.181342:0:14387:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788791664.181345:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791664.181347:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791664.181349:0:14387:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788791664.181353:0:14387:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9aba89374800 00000020:00000080:3.0:1788791664.181355:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788791664.181421:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791664.181425:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791664.181426:0:14387:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788791664.181429:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791664.181431:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791664.181433:0:14387:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788791664.181436:0:14387:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9aba89374800 00000020:00000080:3.0:1788791664.181438:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788791664.181488:0:14387:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa113159-ee5b-4f24-93ba-c8c094c83d87:14387:1875683630470400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788791664.181558:0:14387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791664.194733:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630470400 00000100:00100000:2.0:1788791664.194748:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630470400 00000100:00100000:2.0:1788791664.194800:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788791664.194810:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+11:14387:x1875683630470400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788791664.195071:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+11:14387:x1875683630470400:12345-0@lo:502:llog_process_th.0 Request processed in 263us (13512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791664.195080:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788791664.203301:0:14387:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba906bd240 going to sleep for 11 seconds 00000100:00100000:3.0:1788791664.203343:0:14387:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa113159-ee5b-4f24-93ba-c8c094c83d87:14387:1875683630470400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788791664.203384:0:14387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791664.203399:0:14387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791664.203401:0:14387:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788791664.203407:0:14387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788791664.204017:0:14343:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788791664.204038:0:14343:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788791664.204061:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a323d7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323d82 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791664.204072:0:14343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a323d7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323d82 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791664.204115:0:14343:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788791664.204118:0:14343:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9aba89374800 10000000:01000000:2.0:1788791664.204121:0:14343:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9aba89374800 10000000:01000000:2.0:1788791664.204145:0:14343:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788791664.204152:0:14343:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9aba89374800 from 1 10000000:01000000:2.0:1788791664.204154:0:14343:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788791664.204194:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791664.204203:0:14343:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791664.204222:0:14343:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791664.204244:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb043b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630470528:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788791664.204305:0:14343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791664.204335:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788791664.204355:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630470528 00000100:00100000:2.0:1788791664.204361:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630470528 00000100:00100000:2.0:1788791664.204400:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788791664.204408:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+11:14343:x1875683630470528:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788791664.204420:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791664.204433:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb81b000/0xcd6380150a323d90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a323d89 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791664.204455:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb81b000/0xcd6380150a323d90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a323d89 expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791664.204464:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb81b000/0xcd6380150a323d90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323d89 expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791664.204472:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81b000, rc 0) 00000100:00100000:2.0:1788791664.204504:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14343:x1875683630470528:12345-0@lo:101:mount.lustre.0 Request processed in 97us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791664.204510:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788791664.204547:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb043b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630470528:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788791664.204560:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323d90 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791664.204576:0:14343:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323d90 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791664.204620:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb043b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630470656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788791664.204645:0:14343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791664.204664:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9803fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788791664.205017:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630470656 00000100:00100000:1.0:1788791664.205022:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630470656 00000100:00100000:1.0:1788791664.205054:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788791664.205062:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14343:x1875683630470656:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788791664.208031:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14343:x1875683630470656:12345-0@lo:501:mount.lustre.0 Request processed in 2960us (3375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791664.208046:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788791664.209236:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb043b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630470656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788791664.209291:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb043b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630470784:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788791664.209349:0:14343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791664.209383:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9803fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788791664.209405:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630470784 00000100:00100000:2.0:1788791664.209412:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630470784 00000100:00100000:2.0:1788791664.209458:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788791664.209467:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14343:x1875683630470784:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788791664.209642:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14343:x1875683630470784:12345-0@lo:503:mount.lustre.0 Request processed in 176us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791664.209650:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788791664.209690:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb043b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630470784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788791664.212270:0:14391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa113159-ee5b-4f24-93ba-c8c094c83d87:14391:1875683630470912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791664.212347:0:14391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791664.212424:0:14391:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98d63480 going to sleep for 11 seconds 00000100:00100000:2.0:1788791664.222820:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630470912 00000100:00100000:2.0:1788791664.222834:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630470912 00000100:00100000:2.0:1788791664.222914:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788791664.222926:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14391:x1875683630470912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788791664.223249:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14391:x1875683630470912:12345-0@lo:502:llog_process_th.0 Request processed in 325us (10901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791664.223268:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788791664.231850:0:14391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d50380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa113159-ee5b-4f24-93ba-c8c094c83d87:14391:1875683630470912:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788791664.233059:0:14391:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788791664.233076:0:14391:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9aba88c60000) 00000020:00000080:1.0:1788791664.233096:0:14391:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1788791664.233203:0:14391:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9aba89374800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788791664.233208:0:14391:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9aba89374800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788791664.233211:0:14391:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9aba89374800 4 00010000:00080000:1.0:1788791664.233242:0:14391:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9aba993ab800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.129@tcp at head 00010000:00010000:1.0:1788791664.236446:0:14391:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788791664.236663:0:14391:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788791664.236706:0:14391:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788791664.236730:0:14391:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcd6380150a323d9e 00000100:00080000:1.0:1788791664.236742:0:14391:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788791664.236748:0:14391:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9aba993ab800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788791664.236787:0:14391:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9abab2d50380 x1875683630471040/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788791664.236828:0:14391:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788791664.237220:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875683630471040:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788791664.237295:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791664.244269:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630471040 00000100:00100000:3.0:1788791664.244285:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630471040 00000100:00100000:0.0:1788791664.246469:0:14391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa113159-ee5b-4f24-93ba-c8c094c83d87:14391:1875683630471168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788791664.246555:0:14391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791664.248369:0:14391:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba91630180 going to sleep for 11 seconds 00000100:00100000:3.0:1788791664.250268:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788791664.250281:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875683630471040:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788791664.250281:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630471168 00000100:00100000:1.0:1788791664.250293:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630471168 00000100:00100000:3.0:1788791664.250407:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875683630471040:12345-0@lo:38:llog_process_th.0 Request processed in 125us (13110us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788791664.250418:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788791664.250526:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788791664.250536:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14391:x1875683630471168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788791664.252084:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14391:x1875683630471168:12345-0@lo:502:llog_process_th.0 Request processed in 1544us (5523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791664.252096:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788791664.252234:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788791664.252243:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9aba993ab800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788791664.252249:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788791664.252253:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875683630471040:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788791664.252307:0:14391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:aa113159-ee5b-4f24-93ba-c8c094c83d87:14391:1875683630471168:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788791664.252342:0:14391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788791664.263203:0:14343:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788791664.263246:0:14343:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788791664.263266:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323d90 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791664.263279:0:14343:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb81b800/0xcd6380150a323d89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323d90 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788791664.263348:0:14343:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788791664.263351:0:14343:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788791664.263352:0:14343:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788791664.263354:0:14343:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788791664.263355:0:14343:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788791664.263357:0:14343:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788791664.263358:0:14343:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788791664.263360:0:14343:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788791664.263361:0:14343:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788791664.263363:0:14343:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788791664.263366:0:14343:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788791664.263369:0:14343:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788791664.263370:0:14343:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788791664.263372:0:14343:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788791664.263373:0:14343:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788791664.263374:0:14343:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788791664.263375:0:14343:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788791664.263376:0:14343:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788791664.263377:0:14343:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788791664.263379:0:14343:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788791664.263380:0:14343:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788791664.263407:0:14343:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788791664.263426:0:14343:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630471296:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788791664.263517:0:14343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791664.263556:0:14343:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9803fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788791664.263594:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630471296 00000100:00100000:2.0:1788791664.263601:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630471296 00000100:00100000:2.0:1788791664.263647:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788791664.263656:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14343:x1875683630471296:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788791664.263693:0:14354:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788791664.263706:0:14354:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788791664.329637:0:14354:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788791664.329655:0:14354:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788791664.329704:0:14377:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788791664.329709:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788791664.329742:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9aba994ffe00/0xcd6380150a323da5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791664.329761:0:14377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba994ff200/0xcd6380150a323d74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323d6d expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791664.329781:0:14377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9aba994ffe00/0xcd6380150a323da5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791664.329816:0:14377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba994ff200/0xcd6380150a323d74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a323d6d expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791664.329830:0:14377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9aba994ff200/0xcd6380150a323d74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a323d6d expref: 12 pid: 14355 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791664.329845:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14377:1875683630471424:0@lo:104: 00000100:00100000:0.0:1788791664.329923:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791664.329967:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8571aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788791664.331303:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630471424 00000100:00100000:3.0:1788791664.331313:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630471424 00000100:00100000:3.0:1788791664.331355:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788791664.331365:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+3:14377:x1875683630471424:12345-0@lo:104: 00010000:00010000:3.0:1788791664.331380:0:14344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba994ff000/0xcd6380150a323d6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a323d74 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791664.331449:0:14344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788791664.331456:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+3:14377:x1875683630471424:12345-0@lo:104: Request processed in 92us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791664.331463:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788791664.331609:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14377:1875683630471424:0@lo:104: 00010000:00010000:0.0:1788791664.331631:0:14377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9aba994ffe00/0xcd6380150a323da5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791664.331870:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791664.331877:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba994ff000/0xcd6380150a323d6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a323d74 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791664.331885:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff000 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:1.0:1788791664.331889:0:14350:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba994ff000/0xcd6380150a323d6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a323d74 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791664.331897:0:14350:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba994ff000/0xcd6380150a323d6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a323d74 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788791664.331904:0:14350:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba994ff000/0xcd6380150a323d6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a323d74 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788791664.331910:0:14350:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788791664.331943:0:14350:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba994ff000/0xcd6380150a323d6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323d74 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791664.331951:0:14350:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788791664.331969:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba994ff000/0xcd6380150a323d6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323d74 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791664.331986:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba994ff000/0xcd6380150a323d6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323d74 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791664.332003:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791664.332005:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791664.332006:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791664.332055:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa113159-ee5b-4f24-93ba-c8c094c83d87:3315:1875683630471552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788791664.332092:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791664.332695:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630471552 00000100:00100000:3.0:1788791664.332701:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630471552 00010000:00010000:3.0:1788791664.332729:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba994ff200/0xcd6380150a323d74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a323d6d expref: 13 pid: 14355 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791664.332758:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788791664.332765:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+13:3315:x1875683630471552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788791664.332781:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791664.332787:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba994ff200/0xcd6380150a323d74 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a323d6d expref: 13 pid: 14355 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791664.332797:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba994ff200/0xcd6380150a323d74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a323d6d expref: 13 pid: 14355 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791664.332809:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994ff200/0xcd6380150a323d74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a323d6d expref: 13 pid: 14355 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791664.332822:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9aba994ffe00/0xcd6380150a323da5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791664.332830:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ffe00/0xcd6380150a323da5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788791664.332842:0:14346:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003133781s 00010000:00010000:3.0:1788791664.332847:0:14346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9aba994ffe00/0xcd6380150a323da5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791664.332853:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9aba994ffe00/0xcd6380150a323da5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791664.332860:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9aba994ffe00/0xcd6380150a323da5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791664.332867:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9aba994ffe00/0xcd6380150a323da5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791664.332872:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ffe00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791664.332876:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9aba994ffe00/0xcd6380150a323da5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791664.332887:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9aba994ffe00/0xcd6380150a323da5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791664.338569:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14343:x1875683630471296:12345-0@lo:253:mount.lustre.0 Request processed in 74904us (75043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791664.338583:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788791664.338686:0:14343:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:14343:1875683630471296:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788791664.338701:0:14343:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788791664.338705:0:14343:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788791664.338707:0:14343:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788791664.338708:0:14343:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791664.338709:0:14343:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791664.338711:0:14343:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791664.338712:0:14343:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791664.338713:0:14343:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788791664.338714:0:14343:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788791664.338716:0:14343:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791664.338728:0:14343:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788791664.338743:0:14343:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788791664.342383:0:14377:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9aba994ffe00/0xcd6380150a323da5 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791664.342401:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9aba994ffe00/0xcd6380150a323da5 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791664.342817:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9aba994ffe00/0xcd6380150a323da5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791664.342829:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994ffe00/0xcd6380150a323da5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791664.342849:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791664.342971:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+11:3315:x1875683630471552:12345-0@lo:103:ldlm_bl.0 Request processed in 10202us (10875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791664.342981:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:2.0:1788791664.344936:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00000100:00100000:1.0:1788791664.345645:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa113159-ee5b-4f24-93ba-c8c094c83d87:3315:1875683630471552:0@lo:103:ldlm_bl.0 00080000:10000000:3.0:1788791664.345902:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788791664.346368:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788791664.346532:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788791664.346823:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788791664.346985:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788791664.348284:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788791664.348459:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788791664.348934:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788791664.353978:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788791664.354844:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788791664.355750:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788791664.398802:0:14343:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788791664.399630:0:14343:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788791664.399887:0:14399:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788791664.399891:0:14399:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788791664.400248:0:14400:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788791664.400343:0:14400:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788791664.407991:0:14400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788791664.409707:0:14400:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788791664.409713:0:14400:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1788791664.416524:0:14343:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788791664.416708:0:14343:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788791664.418469:0:14343:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788791664.418485:0:14343:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788791664.418691:0:14343:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788791664.427654:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788791664.429183:0:14343:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788791664.429427:0:14343:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788791664.432902:0:14343:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788791664.443774:0:14343:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788791664.494691:0:14343:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788791664.494790:0:14343:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadda40c87988 00100000:10000000:3.0:1788791664.494799:0:14343:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788791664.501755:0:14343:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788791664.501774:0:14343:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788791664.501790:0:14343:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788791664.501816:0:14343:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788791664.748769:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788791665.124587:0:14358:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788791665.124595:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9aba89374800 from 6 10000000:01000000:1.0:1788791665.124600:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788791665.124644:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abab2c00c00/0xcd6380150a323dac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791665.124656:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9abab2c00c00/0xcd6380150a323dac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791665.124668:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9abab2c00c00/0xcd6380150a323dac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791665.124703:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630471680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788791665.124779:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791665.124840:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98e21780 going to sleep for 11 seconds 00000100:00100000:2.0:1788791665.125782:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630471680 00000100:00100000:2.0:1788791665.125794:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630471680 00000100:00100000:2.0:1788791665.125854:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788791665.125864:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+11:14358:x1875683630471680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791665.125878:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791665.125895:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb81be00/0xcd6380150a323db3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a323dac expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791665.125936:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb81be00/0xcd6380150a323db3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a323dac expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791665.125946:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb81be00/0xcd6380150a323db3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323dac expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791665.125955:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81be00, rc 0) 00000100:00100000:2.0:1788791665.126023:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14358:x1875683630471680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791665.126036:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788791665.126083:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d51f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630471680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791665.126098:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9abab2c00c00/0xcd6380150a323dac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323db3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791665.126107:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9abab2c00c00/0xcd6380150a323dac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323db3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791665.126188:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb042300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630471808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788791665.126220:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791665.126242:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba89179cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791665.126807:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630471808 00000100:00100000:1.0:1788791665.126813:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630471808 00000100:00100000:1.0:1788791665.126847:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788791665.126855:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14358:x1875683630471808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788791665.126870:0:14354:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788791665.126886:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788791665.126889:0:14354:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788791665.126968:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14358:x1875683630471808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 114us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791665.126975:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788791665.127521:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb042300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630471808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788791665.127563:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788791665.127570:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9abab2c00c00/0xcd6380150a323dac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323db3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791665.127579:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9abab2c00c00/0xcd6380150a323dac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323db3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788791665.251769:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788791665.770958:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788791666.279203:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788791666.790145:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791667.812312:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791668.838319:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788791669.273794:0:14643:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788791669.553061:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788791669.553068:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788791669.553071:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788791669.553074:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788791669.553077:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788791669.553080:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788791669.553084:0:37:0:(import.c:65:import_set_state_nolock()) ffff9aba993ab800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788791669.553096:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9aba993ab800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788791669.553117:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ab982a3d180 x1875683630472064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788791669.553234:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630471936:0@lo:400:kworker.0 00000100:00100000:3.0:1788791669.553304:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791669.553378:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630471936 00000100:00100000:3.0:1788791669.553385:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630471936 00000100:00100000:3.0:1788791669.553425:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788791669.553435:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:3312:x1875683630471936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791669.553487:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:3312:x1875683630471936:12345-0@lo:400:kworker.0 Request processed in 53us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791669.553505:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788791669.553553:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630471936:0@lo:400:kworker.0 00000100:00100000:0.0:1788791669.553704:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875683630472064:0@lo:38:kworker.0 00000100:00100000:0.0:1788791669.553734:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791669.554652:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630472064 00000100:00100000:3.0:1788791669.554660:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630472064 00000100:00100000:3.0:1788791669.554682:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788791669.554689:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875683630472064:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788791669.554710:0:14363:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:3.0:1788791669.554743:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcd6380150a323dba 00000004:00100000:3.0:1788791669.554758:0:14363:0:(mdt_handler.c:7335:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788791669.554949:0:14363:0:(import.c:65:import_set_state_nolock()) ffff9abab29f8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788791669.555004:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875683630472064:12345-0@lo:38:kworker.0 Request processed in 314us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791669.555012:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788791669.557347:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ab982a3d180 x1875683630472064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788791679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788791669.557370:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788791669.557378:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788791669.557384:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788791669.557387:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9aba993ab800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788791669.557395:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875683630472064:0@lo:38:kworker.0 00010000:00010000:1.0:1788791669.860916:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791670.887152:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791671.910992:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788791672.853523:0:14793:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf09c9a20 20000000:00000080:0.0:1788791672.853539:0:14793:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ababaf40800 uarg=0000000000000000 20000000:01000000:0.0:1788791672.853583:0:14793:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788791672.853590:0:14793:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788791672.853594:0:14793:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788791672.854554:0:14794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788791672.854764:0:14793:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788791672.861094:0:14793:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788791672.861287:0:14793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9aba994ff200/0xcd6380150a323dc1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791672.861307:0:14793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9abab2c01800/0xcd6380150a323d82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323d7b expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791672.861329:0:14793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9aba994ff200/0xcd6380150a323dc1 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791672.861369:0:14793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9abab2c01800/0xcd6380150a323d82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a323d7b expref: 11 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791672.861382:0:14793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9abab2c01800/0xcd6380150a323d82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a323d7b expref: 11 pid: 14356 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791672.861396:0:14793:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14793:1875683630472192:0@lo:104: 00000100:00100000:0.0:1788791672.861454:0:14793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791672.861498:0:14793:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba83055240 going to sleep for 11 seconds 00000100:00100000:1.0:1788791672.867761:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630472192 00000100:00100000:1.0:1788791672.867775:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630472192 00000100:00100000:1.0:1788791672.867862:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788791672.867873:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa113159-ee5b-4f24-93ba-c8c094c83d87+3:14793:x1875683630472192:12345-0@lo:104: 00010000:00010000:1.0:1788791672.867899:0:14345:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a323d7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a323d82 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791672.867995:0:14345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788791672.868001:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa113159-ee5b-4f24-93ba-c8c094c83d87+3:14793:x1875683630472192:12345-0@lo:104: Request processed in 131us (6547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791672.868019:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788791672.868086:0:14793:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14793:1875683630472192:0@lo:104: 00010000:00010000:0.0:1788791672.868109:0:14793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9aba994ff200/0xcd6380150a323dc1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791672.868191:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791672.868198:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a323d7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a323d82 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791672.868206:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe800 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791672.868210:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a323d7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a323d82 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791672.868219:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a323d7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a323d82 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791672.868226:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a323d7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a323d82 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791672.868232:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788791672.868269:0:14349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a323d7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323d82 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791672.868275:0:14349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791672.868296:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a323d7b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323d82 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791672.868303:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba994fe800/0xcd6380150a323d7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323d82 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791672.868318:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791672.868320:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791672.868322:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791672.868340:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa113159-ee5b-4f24-93ba-c8c094c83d87:3313:1875683630472320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791672.868375:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791672.868781:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630472320 00000100:00100000:1.0:1788791672.868787:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630472320 00010000:00010000:1.0:1788791672.868804:0:14347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9abab2c01800/0xcd6380150a323d82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a323d7b expref: 12 pid: 14356 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791672.868858:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788791672.868865:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:3313:x1875683630472320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788791672.868884:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791672.868890:0:14347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9abab2c01800/0xcd6380150a323d82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a323d7b expref: 12 pid: 14356 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791672.868901:0:14347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9abab2c01800/0xcd6380150a323d82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a323d7b expref: 12 pid: 14356 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791672.868915:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9abab2c01800/0xcd6380150a323d82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a323d7b expref: 12 pid: 14356 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791672.868927:0:14347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9aba994ff200/0xcd6380150a323dc1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791672.868935:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba994ff200/0xcd6380150a323dc1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791672.868948:0:14347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9aba994ff200/0xcd6380150a323dc1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791672.868955:0:14347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9aba994ff200/0xcd6380150a323dc1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791672.868971:0:14347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9aba994ff200/0xcd6380150a323dc1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791672.868978:0:14347:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9aba994ff200/0xcd6380150a323dc1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791672.868984:0:14347:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791672.868988:0:14347:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9aba994ff200/0xcd6380150a323dc1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791672.868994:0:14347:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9aba994ff200/0xcd6380150a323dc1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791672.869012:0:14347:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9aba994ff200/0xcd6380150a323dc1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791672.869021:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791672.869054:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa113159-ee5b-4f24-93ba-c8c094c83d87+11:3313:x1875683630472320:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791672.869060:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788791672.869104:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa113159-ee5b-4f24-93ba-c8c094c83d87:3313:1875683630472320:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788791672.869245:0:14793:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9aba994ff200/0xcd6380150a323dc1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791672.869254:0:14793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9aba994ff200/0xcd6380150a323dc1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791672.869260:0:14793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba994ff200/0xcd6380150a323dc1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791672.932962:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791673.956261:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788791674.403383:0:14358:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788791674.403390:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9aba89374800 from 10 10000000:01000000:0.0:1788791674.403395:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788791674.403439:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a323dc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791674.403457:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a323dc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791674.403469:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a323dc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791674.403492:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630472448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788791674.403565:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791674.403686:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba83055840 going to sleep for 11 seconds 00000100:00100000:2.0:1788791674.406548:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630472448 00000100:00100000:2.0:1788791674.406563:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630472448 00000100:00100000:2.0:1788791674.406665:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788791674.406676:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+11:14358:x1875683630472448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791674.406690:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791674.406707:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb81b600/0xcd6380150a323dcf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a323dc8 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791674.406732:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb81b600/0xcd6380150a323dcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a323dc8 expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791674.406742:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb81b600/0xcd6380150a323dcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323dc8 expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791674.406750:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81b600, rc 0) 00000100:00100000:2.0:1788791674.406818:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14358:x1875683630472448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (3253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791674.406824:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788791674.406982:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630472448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791674.407000:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a323dc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323dcf expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791674.407009:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a323dc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323dcf expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791674.407077:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630472576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791674.407109:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791674.410797:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba856b0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788791674.412601:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630472576 00000100:00100000:0.0:1788791674.412616:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630472576 00000100:00100000:0.0:1788791674.412681:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788791674.412692:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14358:x1875683630472576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788791674.413319:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14358:x1875683630472576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 627us (6207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791674.413328:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788791674.413510:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630472576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791674.413582:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb042300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630472704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788791674.413630:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791674.413671:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba89179e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788791674.413886:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630472704 00000100:00100000:3.0:1788791674.413899:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630472704 00000100:00100000:2.0:1788791674.414385:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788791674.414404:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14358:x1875683630472704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788791674.414600:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:14358:x1875683630472704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791674.414608:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788791674.414789:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb042300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630472704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788791674.416049:0:14857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788791674.417746:0:14358:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788791674.417774:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788791674.417784:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a323dc8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323dcf expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791674.417795:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a323dc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323dcf expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791674.659581:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788791664/real 1788791664] req@ffff9ababb82dc00 x1875683630469376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788791674 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791674.659611:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ababb82dc00 x1875683630469376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788791674 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791674.659622:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788791664/real 1788791664] req@ffff9ababb041f80 x1875683630469248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788791674 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791674.659669:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ababb041f80 x1875683630469248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788791674 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788791674.659688:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ababab12800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788791674.659706:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788791674.659710:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630469376:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788791674.659716:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9abab306e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788791674.659722:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788791674.659724:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630469248:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788791674.659966:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788791674.659971:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788791674.659975:0:8:0:(import.c:65:import_set_state_nolock()) ffff9abab306e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788791674.659980:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:3.0:1788791674.659984:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788791674.659990:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9abab306e800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788791674.660009:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ab982a3fb80 x1875683630472960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788791674.660034:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788791674.660037:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788791674.660039:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ababab12800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788791674.660042:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:3.0:1788791674.660045:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788791674.660048:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ababab12800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788791674.660060:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ab982a3e300 x1875683630473088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788791674.660111:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa113159-ee5b-4f24-93ba-c8c094c83d87:3314:1875683630472832:0@lo:400:kworker.0 00000100:00100000:3.0:1788791674.660207:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791674.660410:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788791674.660416:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630473216:0@lo:400:kworker.0 00000100:00100000:3.0:1788791674.660446:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791674.660471:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630472960:0@lo:8:kworker.0 00000400:00000100:3.0:1788791674.660488:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683630472960 offset 0 length 520: 4 00000100:00100000:3.0:1788791674.660497:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630473088:0@lo:8:kworker.0 00000400:00000100:3.0:1788791674.660507:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875683630473088 offset 0 length 520: 4 00000100:00100000:0.0:1788791674.660755:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630473216 00000100:00100000:0.0:1788791674.660763:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630473216 00000100:00100000:0.0:1788791674.660803:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788791674.660810:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630473216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791674.660856:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630473216:12345-0@lo:400:kworker.0 Request processed in 47us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791674.660862:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788791674.660894:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ab982a3ea00 x1875683630473216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791690 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791674.660905:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630473216:0@lo:400:kworker.0 00000100:00100000:3.0:1788791674.664276:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630472832 00000100:00100000:3.0:1788791674.664291:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630472832 00000100:00100000:3.0:1788791674.664336:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788791674.664346:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:3314:x1875683630472832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791674.664424:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:3314:x1875683630472832:12345-0@lo:400:kworker.0 Request processed in 80us (4217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791674.664431:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788791674.664753:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa113159-ee5b-4f24-93ba-c8c094c83d87:3314:1875683630472832:0@lo:400:kworker.0 00010000:00010000:1.0:1788791674.979333:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791676.003395:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788791676.515726:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788791677.027739:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791678.051526:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788791678.795692:0:15042:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788791678.795695:0:15042:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788791678.795872:0:15042:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9aba993ab000 00000020:01000004:1.0:1788791678.795886:0:15042:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788791678.795899:0:15042:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788791678.795912:0:15042:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9aba88c64d28) 00000020:00000080:1.0:1788791678.795926:0:15042:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788791678.827380:0:15042:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788791678.827724:0:15042:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788791678.828797:0:15042:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788791678.829022:0:15042:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788791678.830010:0:15042:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788791678.834710:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:1.0:1788791678.834814:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:1.0:1788791678.834919:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:1.0:1788791678.837062:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 718: rc = 0 00100000:10000000:1.0:1788791678.837821:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 718: rc = 0 00100000:10000000:1.0:1788791678.838077:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 718: rc = 0 00100000:10000000:1.0:1788791678.838371:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 718: rc = 0 00100000:10000000:1.0:1788791678.838777:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 718: rc = 0 00100000:10000000:1.0:1788791678.839027:0:15042:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 718: rc = 0 00000020:00000080:1.0:1788791678.841803:0:15042:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788791678.841817:0:15042:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788791678.841828:0:15042:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd6380150a323ddd 00000020:01000004:1.0:1788791678.841837:0:15042:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788791678.841856:0:15042:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788791678.841860:0:15042:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788791678.841865:0:15042:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788791678.841870:0:15042:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788791678.841881:0:15042:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9aba88c619b8) 00000020:00000080:1.0:1788791678.841890:0:15042:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1788791678.843501:0:15042:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788791678.844011:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1788791678.844019:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788791678.847661:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788791678.847673:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788791678.848621:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788791678.848628:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788791678.849872:0:15042:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788791678.850063:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788791678.850069:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788791678.856676:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788791678.856687:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788791678.877112:0:15042:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788791678.878388:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788791678.878395:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788791678.882322:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788791678.882342:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788791678.886544:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788791678.886619:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788791678.890926:0:15042:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788791678.891109:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788791678.891283:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788791678.893843:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788791678.893856:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788791678.978420:0:15042:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788791678.978631:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788791678.978638:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788791678.980529:0:15042:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788791678.980543:0:15042:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788791678.981073:0:15042:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788791678.981109:0:15042:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788791678.981161:0:15042:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788791678.998448:0:15042:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788791678.998507:0:15042:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.129@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788791678.998512:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788791678.998514:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788791678.998515:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788791678.998516:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788791678.998518:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788791678.998519:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788791678.998520:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788791678.998522:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788791678.998523:0:15042:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788791678.998526:0:15042:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788791678.998528:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788791678.998529:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788791678.998530:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788791678.998531:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788791678.998532:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788791678.998533:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788791678.998534:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788791678.998536:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788791678.998537:0:15042:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788791678.998561:0:15042:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788791678.998580:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630473344:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788791678.998651:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791678.998811:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630473344 00000100:00100000:0.0:1788791678.998819:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630473344 00000100:00100000:0.0:1788791678.998876:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788791678.998885:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:15042:x1875683630473344:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788791678.998913:0:14354:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788791678.998916:0:14354:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788791678.998920:0:14354:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788791678.998978:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba991b3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791679.016824:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:15042:x1875683630473344:12345-0@lo:253:mount.lustre.0 Request processed in 17932us (18165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791679.016839:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788791679.017169:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630473344:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788791679.017186:0:15042:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788791679.017189:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788791679.017191:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788791679.017192:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788791679.017193:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788791679.017195:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788791679.017196:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788791679.017198:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788791679.017200:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788791679.017213:0:15042:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788791679.017233:0:15042:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9aba993ab000 from lustre-OST0000 10000000:01000000:3.0:1788791679.017260:0:15042:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788791679.017263:0:15042:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788791679.017270:0:15042:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9abab3e38000 local copy 00010000:00010000:3.0:1788791679.017282:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c800/0xcd6380150a323cd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323cda expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791679.017522:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630473472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791679.017559:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791679.017602:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba991b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788791679.017647:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630473472 00000100:00100000:0.0:1788791679.017655:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630473472 00000100:00100000:0.0:1788791679.017702:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788791679.017711:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:15042:x1875683630473472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791679.018376:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:15042:x1875683630473472:12345-0@lo:501:mount.lustre.0 Request processed in 665us (815us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788791679.018386:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788791679.018413:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630473472:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788791679.018431:0:15042:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788791679.018579:0:15042:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788791679.018587:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c800/0xcd6380150a323cd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323cda expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.018596:0:15042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb16c800/0xcd6380150a323cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323cda expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791679.018619:0:15042:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9aba993ab000 10000000:01000000:3.0:1788791679.018624:0:15042:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788791679.018629:0:15042:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9abab3e38000 10000000:01000000:3.0:1788791679.018631:0:15042:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788791679.018635:0:15042:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9abab3e38000 from 1 10000000:01000000:3.0:1788791679.018640:0:15042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788791679.019752:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe200/0xcd6380150a323deb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791679.019766:0:15042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994fe200/0xcd6380150a323deb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791679.019776:0:15042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994fe200/0xcd6380150a323deb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791679.019794:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630473600:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788791679.019835:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791679.019875:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba85001c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788791679.019935:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630473600 00000100:00100000:3.0:1788791679.019941:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630473600 00000100:00100000:3.0:1788791679.020052:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788791679.020063:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+12:15042:x1875683630473600:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788791679.020098:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791679.020120:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16c600/0xcd6380150a323df2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a323deb expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.020167:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16c600/0xcd6380150a323df2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a323deb expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.020177:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16c600/0xcd6380150a323df2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323deb expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.020186:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c600, rc 0) 00000100:00100000:3.0:1788791679.020217:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+13:15042:x1875683630473600:12345-0@lo:101:mount.lustre.0 Request processed in 156us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791679.020223:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788791679.020290:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630473600:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788791679.020303:0:15042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994fe200/0xcd6380150a323deb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323df2 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791679.020311:0:15042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994fe200/0xcd6380150a323deb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323df2 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791679.020327:0:15042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788791679.020347:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe200/0xcd6380150a323deb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323df2 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791679.020355:0:15042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994fe200/0xcd6380150a323deb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323df2 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791679.020374:0:15042:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788791679.020378:0:15042:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788791679.020383:0:15042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788791679.020385:0:15042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788791679.020400:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fee00/0xcd6380150a323df9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791679.020407:0:15042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994fee00/0xcd6380150a323df9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791679.020415:0:15042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994fee00/0xcd6380150a323df9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791679.020427:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630473728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788791679.020452:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791679.043622:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630473728 00000100:00100000:2.0:1788791679.043638:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630473728 00000100:00100000:2.0:1788791679.045273:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788791679.045289:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+13:15042:x1875683630473728:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788791679.045309:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791679.045328:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb81a800/0xcd6380150a323e00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a323df9 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791679.045361:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb81a800/0xcd6380150a323e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a323df9 expref: 14 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791679.045372:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb81a800/0xcd6380150a323e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323df9 expref: 14 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791679.045381:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81a800, rc 0) 00000100:00100000:2.0:1788791679.045447:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+14:15042:x1875683630473728:12345-0@lo:101:mount.lustre.0 Request processed in 164us (24994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791679.045453:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788791679.046415:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba85001c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788791679.046450:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630473728:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788791679.046501:0:15042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994fee00/0xcd6380150a323df9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323e00 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791679.046511:0:15042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994fee00/0xcd6380150a323df9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323e00 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788791679.047537:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788791679.053571:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788791679.055033:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788791679.055603:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788791679.060740:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788791679.060852:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788791679.060893:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788791679.060926:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788791679.061009:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788791679.061018:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788791679.061173:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630473856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788791679.061253:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791679.061311:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630473856 00000100:00100000:1.0:1788791679.061316:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba830550c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788791679.061320:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630473856 00000100:00100000:2.0:1788791679.061378:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788791679.061388:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+14:15042:x1875683630473856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788791679.061753:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+14:15042:x1875683630473856:12345-0@lo:501:mount.lustre.0 Request processed in 367us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791679.061761:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788791679.064802:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630473856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788791679.064893:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630473984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788791679.064963:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791679.064996:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba830550c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791679.067172:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630473984 00000100:00100000:0.0:1788791679.067188:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630473984 00000100:00100000:1.0:1788791679.068616:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788791679.068635:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+14:15042:x1875683630473984:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788791679.069629:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+14:15042:x1875683630473984:12345-0@lo:503:mount.lustre.0 Request processed in 998us (4661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791679.069640:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788791679.075110:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630473984:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788791679.077747:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788791679.077923:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630474112:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788791679.078003:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788791679.078112:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791679.078329:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba850019c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791679.082474:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630474112 00000100:00100000:3.0:1788791679.082491:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630474112 00000100:00100000:3.0:1788791679.082563:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788791679.082575:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+14:15042:x1875683630474112:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788791679.082921:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+14:15042:x1875683630474112:12345-0@lo:502:mount.lustre.0 Request processed in 348us (4917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791679.082931:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788791679.083302:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630474112:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788791679.083605:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788791679.083662:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788791679.083698:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788791679.083748:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788791679.084005:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788791679.084056:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788791679.084110:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788791679.085758:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788791679.085879:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1788791679.085954:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1788791679.085994:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1788791679.086109:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1788791679.086175:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630474240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788791679.086258:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791679.086626:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba83055900 going to sleep for 11 seconds 00000100:00100000:3.0:1788791679.086709:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630474240 00000100:00100000:3.0:1788791679.086717:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630474240 00000100:00100000:3.0:1788791679.086841:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788791679.086853:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+14:15042:x1875683630474240:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788791679.087509:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+14:15042:x1875683630474240:12345-0@lo:502:mount.lustre.0 Request processed in 656us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791679.087528:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788791679.087753:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d52a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630474240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788791679.087935:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788791679.087948:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788791679.089631:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788791679.089642:0:15056:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788791679.089649:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788791679.089652:0:15056:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788791679.089659:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788791679.089674:0:15056:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9ababc14cd28) 00000020:00000080:2.0:1788791679.089701:0:15056:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788791679.089707:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788791679.089858:0:15056:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9aba993ab000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788791679.089866:0:15056:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788791679.089874:0:15056:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd6380150a323e0e 00010000:00010000:3.0:1788791679.103782:0:15056:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788791679.104191:0:15056:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1788791679.110828:0:15056:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788791679.112305:0:15056:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788791679.112317:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791679.112322:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791679.112324:0:15056:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788791679.112329:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788791679.112331:0:15056:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1788791679.112333:0:15056:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788791679.112334:0:15056:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788791679.112336:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788791679.112338:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791679.112340:0:15056:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788791679.112342:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791679.112345:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791679.112346:0:15056:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788791679.112349:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788791679.112351:0:15056:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788791679.112353:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791679.112355:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791679.112356:0:15056:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788791679.112358:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791679.112361:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791679.112362:0:15056:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788791679.112364:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788791679.112426:0:15056:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791679.112429:0:15056:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791679.112430:0:15056:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788791679.112434:0:15056:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788791679.112740:0:15042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788791679.112786:0:15042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788791679.112809:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fee00/0xcd6380150a323df9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323e00 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.112822:0:15042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994fee00/0xcd6380150a323df9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323e00 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791679.112831:0:15042:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9aba993ab000 from 1 10000000:01000000:3.0:1788791679.112834:0:15042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788791679.112873:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16ca00/0xcd6380150a323e15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.112881:0:15042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb16ca00/0xcd6380150a323e15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.112892:0:15042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb16ca00/0xcd6380150a323e15 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791679.112916:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630474368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788791679.112983:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791679.113021:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788791679.116188:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630474368 00000100:00100000:3.0:1788791679.116201:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630474368 00000100:00100000:3.0:1788791679.116256:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788791679.116272:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+14:15042:x1875683630474368:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788791679.116290:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791679.116308:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16dc00/0xcd6380150a323e1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a323e15 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.116335:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16dc00/0xcd6380150a323e1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a323e15 expref: 15 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.116345:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16dc00/0xcd6380150a323e1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323e15 expref: 15 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.116354:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16dc00, rc 0) 00000100:00100000:3.0:1788791679.116427:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+15:15042:x1875683630474368:12345-0@lo:101:mount.lustre.0 Request processed in 156us (3443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791679.116433:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788791679.116498:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630474368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788791679.116516:0:15042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb16ca00/0xcd6380150a323e15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323e1c expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.116525:0:15042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb16ca00/0xcd6380150a323e15 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323e1c expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788791679.117296:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788791679.119376:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788791679.119745:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788791679.119792:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788791679.121454:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788791679.121486:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788791679.121595:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630474496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791679.121672:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791679.121723:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788791679.122215:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630474496 00000100:00100000:0.0:1788791679.122224:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630474496 00000100:00100000:0.0:1788791679.122270:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788791679.122279:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+15:15042:x1875683630474496:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791679.122531:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+15:15042:x1875683630474496:12345-0@lo:501:mount.lustre.0 Request processed in 252us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791679.122539:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788791679.122717:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630474496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788791679.122891:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb042300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630474624:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788791679.122934:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791679.132833:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abaab4a79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788791679.132985:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630474624 00000100:00100000:3.0:1788791679.132995:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630474624 00000100:00100000:3.0:1788791679.133062:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788791679.133071:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+15:15042:x1875683630474624:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788791679.133325:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+15:15042:x1875683630474624:12345-0@lo:503:mount.lustre.0 Request processed in 254us (10390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791679.133334:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788791679.133806:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb042300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630474624:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788791679.134388:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788791679.134475:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb042300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630474752:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788791679.134529:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791679.134547:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba90446300 going to sleep for 11 seconds 00000100:00100000:1.0:1788791679.134862:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630474752 00000100:00100000:1.0:1788791679.134868:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630474752 00000100:00100000:1.0:1788791679.134910:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788791679.134919:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+15:15042:x1875683630474752:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788791679.135101:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+15:15042:x1875683630474752:12345-0@lo:502:mount.lustre.0 Request processed in 182us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791679.135115:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788791679.136934:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb042300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630474752:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788791679.137542:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788791679.137624:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788791679.137686:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788791679.137722:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788791679.137751:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788791679.137812:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788791679.137849:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788791679.137884:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788791679.137929:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb042300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630474880:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788791679.137997:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791679.138047:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba90446300 going to sleep for 11 seconds 00000100:00100000:1.0:1788791679.140057:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630474880 00000100:00100000:1.0:1788791679.140068:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630474880 00000100:00100000:1.0:1788791679.140116:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788791679.140156:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3058850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+15:15042:x1875683630474880:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788791679.140433:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3058850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+15:15042:x1875683630474880:12345-0@lo:502:mount.lustre.0 Request processed in 308us (2435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791679.140442:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788791679.140825:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb042300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630474880:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788791679.140981:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788791679.140998:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788791679.143027:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791679.143117:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791679.143119:0:15060:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788791679.143182:0:15060:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9aba993ab000 00000020:00000080:0.0:1788791679.143186:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788791679.143193:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791679.143196:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791679.143197:0:15060:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788791679.143200:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791679.143203:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791679.143204:0:15060:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788791679.143207:0:15060:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9aba993ab000 00000020:00000080:0.0:1788791679.143209:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788791679.143308:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791679.143312:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791679.143314:0:15060:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788791679.143317:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788791679.143319:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791679.143320:0:15060:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788791679.143324:0:15060:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9aba993ab000 00000020:00000080:0.0:1788791679.143326:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788791679.144267:0:15060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788791679.144275:0:15060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791679.144277:0:15060:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788791679.144281:0:15060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788791679.149254:0:15042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788791679.149631:0:15042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788791679.149844:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16ca00/0xcd6380150a323e15 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323e1c expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.149858:0:15042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb16ca00/0xcd6380150a323e15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323e1c expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791679.165056:0:15042:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788791679.165064:0:15042:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9aba993ab000 10000000:01000000:0.0:1788791679.165068:0:15042:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9aba993ab000 10000000:01000000:0.0:1788791679.165072:0:15042:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788791679.165078:0:15042:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9aba993ab000 from 1 10000000:01000000:0.0:1788791679.165081:0:15042:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788791679.165119:0:15042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791679.165157:0:15042:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791679.165168:0:15042:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791679.165191:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630475008:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788791679.165258:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791679.165304:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916c5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788791679.165440:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630475008 00000100:00100000:3.0:1788791679.165448:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630475008 00000100:00100000:3.0:1788791679.165510:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788791679.165522:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3059450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+15:15042:x1875683630475008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788791679.165534:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791679.165546:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16c200/0xcd6380150a323e2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a323e23 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.165569:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16c200/0xcd6380150a323e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a323e23 expref: 16 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.165579:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16c200/0xcd6380150a323e2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323e23 expref: 16 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.165595:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c200, rc 0) 00000100:00100000:3.0:1788791679.165632:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3059450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:15042:x1875683630475008:12345-0@lo:101:mount.lustre.0 Request processed in 113us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791679.165640:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788791679.165724:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630475008:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788791679.165739:0:15042:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323e2a expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791679.165748:0:15042:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323e2a expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788791679.171337:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788791679.171834:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788791679.172177:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788791679.172224:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788791679.172258:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788791679.172329:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788791679.172370:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788791679.172412:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788791679.172447:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788791679.172495:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788791679.172544:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788791679.172581:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788791679.172616:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788791679.172664:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788791679.172704:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788791679.172758:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788791679.172809:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788791679.172847:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788791679.172883:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788791679.172930:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788791679.172964:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788791679.172998:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788791679.173045:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788791679.173078:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788791679.173110:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788791679.173200:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788791679.173242:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788791679.173279:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788791679.173330:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788791679.173367:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788791679.173441:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788791679.173450:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788791679.189290:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630475136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791679.189360:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791679.189407:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916c5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788791679.189887:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630475136 00000100:00100000:2.0:1788791679.189896:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630475136 00000100:00100000:2.0:1788791679.189955:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788791679.189965:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab305b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:15042:x1875683630475136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788791679.190857:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab305b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:15042:x1875683630475136:12345-0@lo:501:mount.lustre.0 Request processed in 890us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791679.190879:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788791679.191209:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630475136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791679.191267:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630475264:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788791679.191322:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791679.191353:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630475264 00000100:00100000:0.0:1788791679.191359:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630475264 00000100:00100000:0.0:1788791679.191394:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788791679.191402:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3059c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:15042:x1875683630475264:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788791679.191579:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3059c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:15042:x1875683630475264:12345-0@lo:503:mount.lustre.0 Request processed in 178us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791679.191587:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788791679.191623:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916c5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788791679.191635:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630475264:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788791679.197555:0:15042:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788791679.197644:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630475392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788791679.197719:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791679.197762:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba916c5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788791679.199053:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630475392 00000100:00100000:3.0:1788791679.199065:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630475392 00000100:00100000:3.0:1788791679.199118:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788791679.199143:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab305b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:15042:x1875683630475392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788791679.199412:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab305b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:15042:x1875683630475392:12345-0@lo:502:mount.lustre.0 Request processed in 285us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791679.199420:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788791679.199643:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630475392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788791679.199947:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788791679.200005:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788791679.200057:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788791679.200108:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788791679.200177:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788791679.200228:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788791679.200265:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788791679.201170:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788791679.201240:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788791679.201279:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788791679.201904:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788791679.201979:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788791679.202016:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788791679.202441:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788791679.202507:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788791679.202537:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788791679.202563:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788791679.202618:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788791679.202651:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788791679.202677:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788791679.202714:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788791679.202741:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788791679.203269:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788791679.209689:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788791679.215215:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788791679.215333:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788791679.215415:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788791679.215449:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788791679.215493:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788791679.215536:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788791679.215601:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788791679.215636:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788791679.215666:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788791679.215711:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788791679.215743:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788791679.215805:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788791679.215842:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788791679.215875:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788791679.215919:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788791679.215953:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788791679.216005:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630475520:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788791679.216087:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791679.216173:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788791679.216569:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630475520 00000100:00100000:1.0:1788791679.216578:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630475520 00000100:00100000:1.0:1788791679.216620:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788791679.216630:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3059850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:15042:x1875683630475520:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788791679.216883:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3059850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:15042:x1875683630475520:12345-0@lo:502:mount.lustre.0 Request processed in 253us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791679.216891:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788791679.219701:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630475520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788791679.219866:0:15042:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788791679.219884:0:15042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788791679.224090:0:15065:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788791679.224161:0:15065:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9abab748b370) 00000020:00000080:3.0:1788791679.224183:0:15065:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788791679.224260:0:15065:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9aba993ab000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788791679.224264:0:15065:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9aba993ab000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788791679.224267:0:15065:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9aba993ab000 3 00010000:00080000:3.0:1788791679.224296:0:15065:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9abaa9b3f800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.129@tcp at head 00010000:00010000:3.0:1788791679.225926:0:15065:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788791679.226120:0:15065:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788791679.226182:0:15065:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788791679.226194:0:15065:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcd6380150a323e38 00000100:00080000:3.0:1788791679.226204:0:15065:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788791679.226209:0:15065:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9abaa9b3f800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:3.0:1788791679.226244:0:15065:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ab982a3ce00 x1875683630475648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788791679.226270:0:15065:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788791679.226305:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788791679.226310:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788791679.226312:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788791679.226315:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788791679.226363:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630475776:0@lo:400:kworker.0 00000100:00100000:3.0:1788791679.226435:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791679.226500:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630475776 00000100:00100000:3.0:1788791679.226507:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630475776 00000100:00100000:3.0:1788791679.226547:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788791679.226556:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630475776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791679.226605:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630475776:12345-0@lo:400:kworker.0 Request processed in 50us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791679.226613:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788791679.226650:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ab982a3d500 x1875683630475776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791679.226663:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630475776:0@lo:400:kworker.0 00000100:00100000:1.0:1788791679.226859:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875683630475648:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788791679.226891:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791679.244006:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630475648 00000100:00100000:3.0:1788791679.244022:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630475648 00000100:00100000:3.0:1788791679.244084:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788791679.244093:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875683630475648:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788791679.244146:0:14363:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 455 last 0 00000020:00000080:3.0:1788791679.244208:0:14363:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcd6380150a323e3f 00000004:00100000:3.0:1788791679.244226:0:14363:0:(mdt_handler.c:7335:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788791679.244261:0:14363:0:(import.c:65:import_set_state_nolock()) ffff9aba851e7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788791679.244354:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875683630475648:12345-0@lo:38:llog_process_th.0 Request processed in 261us (17461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791679.244363:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1788791679.244542:0:15065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:1.0:1788791679.246251:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9ab982a3ce00 x1875683630475648/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788791689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791679.246264:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788791679.246276:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788791679.246284:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788791679.246288:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788791679.246291:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9abaa9b3f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788791679.246311:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875683630475648:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788791679.246360:0:15042:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788791679.246394:0:15042:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788791679.246413:0:15042:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323e2a expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791679.246423:0:15042:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba994fe600/0xcd6380150a323e23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323e2a expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788791679.246474:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788791679.246477:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788791679.246478:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788791679.246479:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788791679.246480:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788791679.246481:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788791679.246483:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788791679.246485:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788791679.246486:0:15042:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788791679.246491:0:15042:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788791679.246493:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788791679.246494:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788791679.246496:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788791679.246497:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788791679.246498:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788791679.246499:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788791679.246500:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788791679.246501:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788791679.246502:0:15042:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788791679.246524:0:15042:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788791679.246542:0:15042:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630475904:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788791679.246597:0:15042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791679.246636:0:15042:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba83055e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788791679.246713:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630475904 00000100:00100000:2.0:1788791679.246719:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630475904 00000100:00100000:2.0:1788791679.246763:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788791679.246783:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab305bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:15042:x1875683630475904:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788791679.246808:0:14354:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788791679.246821:0:14354:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788791679.296550:0:14354:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788791679.296563:0:14354:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788791679.296596:0:14377:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788791679.296613:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788791679.296637:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ababb16d400/0xcd6380150a323e46 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.296658:0:14377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ababb81be00/0xcd6380150a323db3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323dac expref: 16 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.296666:0:14377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ababb16d400/0xcd6380150a323e46 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.296706:0:14377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ababb81be00/0xcd6380150a323db3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a323dac expref: 16 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.296720:0:14377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ababb81be00/0xcd6380150a323db3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a323dac expref: 16 pid: 14356 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791679.296734:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14377:1875683630476032:0@lo:104: 00000100:00100000:3.0:1788791679.296809:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791679.296846:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8665a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788791679.296870:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630476032 00000100:00100000:3.0:1788791679.296878:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630476032 00000100:00100000:3.0:1788791679.296927:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788791679.296936:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa113159-ee5b-4f24-93ba-c8c094c83d87+3:14377:x1875683630476032:12345-0@lo:104: 00010000:00010000:3.0:1788791679.296948:0:14345:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9abab2c00c00/0xcd6380150a323dac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a323db3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.296999:0:14345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788791679.297006:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:aa113159-ee5b-4f24-93ba-c8c094c83d87+3:14377:x1875683630476032:12345-0@lo:104: Request processed in 71us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791679.297013:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788791679.297207:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14377:1875683630476032:0@lo:104: 00010000:00010000:3.0:1788791679.297225:0:14377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ababb16d400/0xcd6380150a323e46 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297241:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791679.297246:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9abab2c00c00/0xcd6380150a323dac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a323db3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297253:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00c00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:3.0:1788791679.297257:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9abab2c00c00/0xcd6380150a323dac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a323db3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297264:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9abab2c00c00/0xcd6380150a323dac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a323db3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788791679.297271:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9abab2c00c00/0xcd6380150a323dac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a323db3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791679.297277:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788791679.297304:0:14349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9abab2c00c00/0xcd6380150a323dac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323db3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297311:0:14349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788791679.297329:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9abab2c00c00/0xcd6380150a323dac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323db3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297336:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9abab2c00c00/0xcd6380150a323dac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323db3 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297351:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791679.297353:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791679.297360:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791679.297380:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa113159-ee5b-4f24-93ba-c8c094c83d87:3313:1875683630476160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788791679.297407:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791679.297443:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630476160 00000100:00100000:3.0:1788791679.297447:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630476160 00010000:00010000:3.0:1788791679.297474:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ababb81be00/0xcd6380150a323db3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a323dac expref: 17 pid: 14356 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791679.297494:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788791679.297501:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:3313:x1875683630476160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788791679.297511:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791679.297515:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ababb81be00/0xcd6380150a323db3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a323dac expref: 17 pid: 14356 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297526:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ababb81be00/0xcd6380150a323db3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a323dac expref: 17 pid: 14356 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297539:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb81be00/0xcd6380150a323db3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a323dac expref: 17 pid: 14356 timeout: 555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297551:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ababb16d400/0xcd6380150a323e46 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297559:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16d400/0xcd6380150a323e46 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788791679.297570:0:14346:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003133781s 00010000:00010000:3.0:1788791679.297574:0:14346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ababb16d400/0xcd6380150a323e46 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297581:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ababb16d400/0xcd6380150a323e46 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297594:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ababb16d400/0xcd6380150a323e46 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297600:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ababb16d400/0xcd6380150a323e46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297606:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791679.297610:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ababb16d400/0xcd6380150a323e46 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297617:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ababb16d400/0xcd6380150a323e46 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297630:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ababb16d400/0xcd6380150a323e46 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297640:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791679.297670:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:3313:x1875683630476160:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791679.297677:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788791679.297699:0:14377:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ababb16d400/0xcd6380150a323e46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297705:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ababb16d400/0xcd6380150a323e46 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791679.297711:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16d400/0xcd6380150a323e46 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791679.297732:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa113159-ee5b-4f24-93ba-c8c094c83d87:3313:1875683630476160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788791679.309986:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab305bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+15:15042:x1875683630475904:12345-0@lo:253:mount.lustre.0 Request processed in 63195us (63379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791679.310002:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788791679.310270:0:15042:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d51500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15042:1875683630475904:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788791679.310476:0:15042:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788791679.310480:0:15042:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788791679.310482:0:15042:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788791679.310483:0:15042:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788791679.310484:0:15042:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788791679.310485:0:15042:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788791679.310486:0:15042:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788791679.310488:0:15042:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788791679.310490:0:15042:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788791679.310491:0:15042:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788791679.310507:0:15042:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788791679.316027:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788791679.318646:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788791679.318909:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788791679.319476:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788791679.319726:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788791679.320014:0:15042:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788791679.322451:0:15042:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788791679.414958:0:15042:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788791679.414967:0:15042:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788791679.414998:0:15042:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788791679.415162:0:15042:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788791679.415178:0:15042:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788791679.415209:0:15042:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788791680.100482:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791681.135050:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788791681.258748:0:14358:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788791681.258756:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9aba89374800 from 7 10000000:01000000:3.0:1788791681.258761:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788791681.258808:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16d400/0xcd6380150a323e4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791681.258820:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb16d400/0xcd6380150a323e4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791681.258831:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb16d400/0xcd6380150a323e4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791681.258856:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630476288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788791681.258921:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791681.258967:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8665ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788791681.259045:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630476288 00000100:00100000:3.0:1788791681.259052:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630476288 00000100:00100000:3.0:1788791681.259097:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788791681.259106:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab305a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+15:14358:x1875683630476288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791681.259118:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791681.259168:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16cc00/0xcd6380150a323e54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a323e4d expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791681.259206:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16cc00/0xcd6380150a323e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a323e4d expref: 16 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791681.259216:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16cc00/0xcd6380150a323e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323e4d expref: 16 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791681.259225:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16cc00, rc 0) 00000100:00100000:3.0:1788791681.259264:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab305a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:14358:x1875683630476288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791681.259270:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788791681.259330:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630476288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788791681.259345:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb16d400/0xcd6380150a323e4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323e54 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791681.259353:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb16d400/0xcd6380150a323e4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323e54 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791681.259398:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630476416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788791681.259437:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791681.259466:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba8665ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788791681.261011:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630476416 00000100:00100000:3.0:1788791681.261022:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630476416 00000100:00100000:3.0:1788791681.261070:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788791681.261080:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab305ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:14358:x1875683630476416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788791681.261100:0:14354:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788791681.261121:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788791681.261147:0:14354:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788791681.261249:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab305ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:14358:x1875683630476416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 169us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791681.261257:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788791681.261301:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630476416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788791681.261361:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788791681.261370:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16d400/0xcd6380150a323e4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323e54 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791681.261379:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb16d400/0xcd6380150a323e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323e54 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791682.149159:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791683.172459:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791684.195384:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788791684.387473:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788791684.387480:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788791684.387482:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788791684.387485:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788791684.387536:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630476672:0@lo:400:kworker.0 00000100:00100000:2.0:1788791684.387612:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791684.387663:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788791684.387669:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa113159-ee5b-4f24-93ba-c8c094c83d87:3315:1875683630476544:0@lo:400:kworker.0 00000100:00100000:2.0:1788791684.387697:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791684.387727:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630476800:0@lo:400:kworker.0 00000100:00100000:2.0:1788791684.387753:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791684.387817:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630476672 00000100:00100000:2.0:1788791684.387824:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630476672 00000100:00100000:2.0:1788791684.387863:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630476800 00000100:00100000:2.0:1788791684.387866:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630476800 00000100:00100000:2.0:1788791684.387891:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788791684.387900:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630476672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791684.387962:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630476672:12345-0@lo:400:kworker.0 Request processed in 64us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791684.387970:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788791684.387988:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788791684.387994:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630476800:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788791684.388166:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791684.388569:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630476800:12345-0@lo:400:kworker.0 Request processed in 573us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791684.388576:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788791684.388598:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630476544 00000100:00100000:2.0:1788791684.388603:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630476544 00000100:00100000:2.0:1788791684.388640:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788791684.388647:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab305a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:3315:x1875683630476544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791684.388681:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab305a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:3315:x1875683630476544:12345-0@lo:400:kworker.0 Request processed in 35us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791684.388687:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788791684.388737:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababb040a80 x1875683630476800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791684.388751:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb040a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630476800:0@lo:400:kworker.0 00000100:00100000:2.0:1788791684.388778:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa113159-ee5b-4f24-93ba-c8c094c83d87:3315:1875683630476544:0@lo:400:kworker.0 00010000:00080000:2.0:1788791684.388788:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababb040380 x1875683630476672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791684.393668:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb040380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630476672:0@lo:400:kworker.0 00010000:00010000:3.0:1788791685.219316:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791686.243564:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788791686.756439:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1788791686.852939:0:15409:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788791687.267422:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791688.293312:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.322124:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791689.447210:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788791674/real 1788791674] req@ffff9ab982a3fb80 x1875683630472960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788791689 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791689.447242:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ab982a3fb80 x1875683630472960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788791689 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791689.447253:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788791674/real 1788791674] req@ffff9ab982a3e300 x1875683630473088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788791689 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791689.447263:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9ab982a3e300 x1875683630473088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788791689 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788791689.447294:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9abab306e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788791689.455077:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788791689.455089:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630472960:0@lo:8:kworker.0 00000100:00080000:1.0:1788791689.455101:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ababab12800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788791689.460475:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788791689.460488:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630473088:0@lo:8:kworker.0 00000100:00080000:0.0:1788791689.461268:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788791689.461272:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788791689.461285:0:36:0:(import.c:65:import_set_state_nolock()) ffff9abab306e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788791689.461291:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 451 00000100:00080000:0.0:1788791689.461297:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788791689.461304:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9abab306e800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1788791689.461325:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ababb82e300 x1875683630477056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788791689.461343:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788791689.461345:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788791689.461347:0:36:0:(import.c:65:import_set_state_nolock()) ffff9ababab12800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788791689.461350:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 451 00000100:00080000:0.0:1788791689.461352:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788791689.461365:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ababab12800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1788791689.461392:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ababb82fb80 x1875683630477184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788791689.461442:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630477312:0@lo:400:kworker.0 00000100:00100000:0.0:1788791689.461508:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791689.461563:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788791689.461568:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630477440:0@lo:400:kworker.0 00000100:00100000:0.0:1788791689.461933:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791689.461970:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630477056:0@lo:8:kworker.0 00000100:00100000:0.0:1788791689.462002:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791689.462022:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630477184:0@lo:8:kworker.0 00000100:00100000:0.0:1788791689.462044:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791689.462082:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630477056 00000100:00100000:0.0:1788791689.462090:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630477056 00000100:00100000:0.0:1788791689.462113:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630477184 00000100:00100000:0.0:1788791689.462117:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630477184 00000100:00100000:0.0:1788791689.462153:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788791689.462161:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875683630477056:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788791689.462190:0:15045:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:0.0:1788791689.462221:0:15045:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd6380150a323e5b 00002000:00100000:0.0:1788791689.462235:0:15045:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9abaa70e4000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788791689.462239:0:15045:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788791689.462241:0:15045:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788791689.463915:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788791689.463939:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630476928:0@lo:400:kworker.0 00000100:00100000:1.0:1788791689.464001:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791689.464065:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630476928 00000100:00100000:1.0:1788791689.464073:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630476928 00000100:00100000:1.0:1788791689.464113:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788791689.464121:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3058450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:3312:x1875683630476928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791689.464198:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3058450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:3312:x1875683630476928:12345-0@lo:400:kworker.0 Request processed in 77us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791689.464205:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788791689.464250:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630476928:0@lo:400:kworker.0 00002000:00080000:0.0:1788791689.464486:0:15045:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788791689.464519:0:15045:0:(import.c:65:import_set_state_nolock()) ffff9abaa70e1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788791689.464573:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875683630477056:12345-0@lo:8:kworker.0 Request processed in 2412us (2569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791689.465810:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630477312 00000100:00100000:2.0:1788791689.465820:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630477312 00000100:00100000:2.0:1788791689.465901:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630477440 00000100:00100000:2.0:1788791689.465905:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630477440 00000100:00100000:2.0:1788791689.465931:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788791689.465939:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630477312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791689.466002:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630477312:12345-0@lo:400:kworker.0 Request processed in 63us (4493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791689.466008:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788791689.466023:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788791689.466030:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630477440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791689.466057:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630477440:12345-0@lo:400:kworker.0 Request processed in 29us (4126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791689.466063:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788791689.466088:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788791689.466115:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababb82f100 x1875683630477440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791689.466145:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630477440:0@lo:400:kworker.0 00010000:00080000:2.0:1788791689.466158:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababb82d500 x1875683630477312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791689.466179:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630477312:0@lo:400:kworker.0 00000100:00100000:0.0:1788791689.466383:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788791689.466403:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788791689.466408:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875683630477184:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788791689.466425:0:15045:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788791689.466459:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875683630477184:12345-0@lo:8:kworker.0 Request processed in 50us (4414us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788791689.466465:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788791689.466749:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababb82e300 x1875683630477056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788791709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791689.466759:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788791689.466776:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788791689.466784:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788791689.466789:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788791689.466792:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9abab306e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788791689.466818:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788791689.466824:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630477056:0@lo:8:kworker.0 00000100:00080000:1.0:1788791689.466842:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ababab12800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788791689.466846:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788791689.467006:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630477184:0@lo:8:kworker.0 00000004:00080000:2.0:1788791689.467071:0:14383:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788791689.467580:0:14383:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 465847451784ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788791689.469876:0:14384:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788791689.469904:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14384:1875683630477696:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788791689.469969:0:14384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791689.469999:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba856b0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791689.470028:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630477568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791689.470052:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791689.470092:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630477696 00000100:00100000:0.0:1788791689.470099:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630477696 00000100:00100000:0.0:1788791689.470163:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788791689.470173:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14384:x1875683630477696:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1788791689.471810:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791689.474868:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630477568 00000100:00100000:2.0:1788791689.474883:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630477568 00000100:00100000:2.0:1788791689.474944:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791689.474954:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875683630477568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788791689.474992:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791689.475079:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875683630477568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (5024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791689.475086:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788791689.475426:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababb82ce00 x1875683630477568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788791689.475450:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630477568:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1788791689.486731:0:15043:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788791689.486742:0:15043:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788791689.486747:0:15043:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:0.0:1788791689.502576:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.502672:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323e62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.502689:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.502694:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.502700:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323e62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.502718:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323e62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.502729:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323e62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.502737:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323e62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.502761:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791689.502778:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791689.502785:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323e62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.502792:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791689.502797:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323e62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.502805:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323e62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.502830:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323e62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.502837:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323e62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.502926:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.502929:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.502931:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791689.503976:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.503985:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323e69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.503999:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.504003:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.504008:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323e69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.504019:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323e69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.504027:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323e69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.504033:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323e69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.504071:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788791689.504533:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.504539:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323e70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.504549:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.504552:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.504557:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323e70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.504566:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323e70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.504574:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323e70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.504582:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323e70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791689.504858:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788791689.504866:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323e69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791689.504881:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791689.504885:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323e69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791689.504893:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323e69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791689.504911:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323e69 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791689.504919:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323e69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791689.504937:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791689.504939:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791689.504941:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.505357:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788791689.506022:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.506030:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323e77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.506043:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.506053:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.506060:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323e77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.506072:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323e77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.506080:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323e77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.506088:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323e77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.508293:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788791689.508305:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323e70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.508318:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ffa00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791689.508323:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323e70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.508335:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323e70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.513628:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323e70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.513637:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323e70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.513663:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791689.513668:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323e77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.513675:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791689.513680:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323e77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.513690:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323e77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.513700:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323e77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.513706:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791689.513708:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791689.513710:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.515972:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788791689.515988:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323e77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.516261:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791689.521081:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.521094:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323e7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.521112:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.521116:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.521123:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323e7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.521178:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323e7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.521196:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323e7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.521204:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323e7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.521221:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791689.521485:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791689.521493:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323e7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.521504:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791689.521509:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323e7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.521519:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323e7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.521540:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323e7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.521560:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323e7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.521583:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.521585:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.521586:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791689.522003:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.522010:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323e85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.522022:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.522025:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.522030:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323e85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.522040:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323e85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.522048:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323e85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.522054:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323e85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.522090:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791689.522183:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791689.522190:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323e85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.522198:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791689.522203:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323e85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.522210:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323e85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.522223:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323e85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.522232:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323e85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.522249:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.522251:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.522254:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791689.522758:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.522919:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323e8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.522931:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.522935:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.522941:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323e8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.522951:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323e8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.522959:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323e8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.522967:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323e8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.522989:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791689.523038:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791689.523045:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323e8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.523053:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791689.523057:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323e8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.523066:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323e8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.523079:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323e8c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.523085:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323e8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.523106:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.523108:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.523111:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791689.523706:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.523713:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323e93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.523723:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.523734:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.523740:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323e93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.523749:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323e93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.523758:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323e93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.523957:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323e93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.523973:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791689.524000:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791689.524007:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323e93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.524015:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ffe00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791689.524020:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323e93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.524040:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323e93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.524053:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323e93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.524060:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323e93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.524080:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.524083:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.524084:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791689.527198:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.527211:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323e9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.527228:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.527233:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.527240:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323e9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.527254:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323e9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.527266:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323e9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.527293:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323e9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.527318:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791689.530358:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791689.530371:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323e9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.530530:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791689.530538:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323e9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.530551:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323e9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.530573:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323e9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.530602:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323e9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.530621:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.530623:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.530625:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791689.531574:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.531597:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a323ea1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.531614:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.531620:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.531626:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a323ea1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.531640:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a323ea1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.531649:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a323ea1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.531656:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a323ea1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.531672:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788791689.532667:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.532677:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323ea8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.532697:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=465s v=(0 0) 00010000:00010000:2.0:1788791689.532698:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791689.532702:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791689.532707:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a323ea1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.532710:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323ea8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.532730:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791689.532735:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323ea8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.532737:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a323ea1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.532759:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323ea8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.532760:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a323ea1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.532777:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a323ea1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.532784:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a323ea1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.532800:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.532802:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.532804:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.532837:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323ea8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.532937:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788791689.534646:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.534658:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323eaf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.534673:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.534678:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.534684:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323eaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.534696:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323eaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.534717:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323eaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.534725:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323eaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.534921:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788791689.536669:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.536682:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323eb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.536697:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.536701:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.536707:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323eb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.536719:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323eb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.536729:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323eb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.536737:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323eb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.541182:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788791689.541194:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323ea8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.541220:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791689.541224:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323ea8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.541235:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323ea8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.541254:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323ea8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.541261:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007405e041/0xcd6380150a323ea8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.541295:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788791689.541300:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323eaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.541307:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791689.541310:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323eaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.541318:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323eaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.541328:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323eaf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.541341:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2b492e6/0xcd6380150a323eaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.541354:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791689.541358:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323eb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.541364:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791689.541367:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323eb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.541385:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323eb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.541396:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323eb6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.541405:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791689.541406:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791689.541408:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.541724:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788791689.541732:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323eb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.542476:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791689.543289:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.543300:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323ebd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.543316:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.543322:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.543329:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323ebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.543344:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323ebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.543354:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323ebd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.543361:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323ebd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.544296:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788791689.545293:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.545303:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323ec4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.545326:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.545330:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.545337:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323ec4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.545351:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323ec4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.545360:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323ec4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.545475:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323ec4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.545489:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788791689.546203:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.546210:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323ecb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.546221:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.546225:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.546230:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323ecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.546240:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323ecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.546259:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323ecb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.546265:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323ecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.546284:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788791689.548690:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788791689.548741:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323ebd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.548755:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ffe00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791689.548780:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323ebd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.548791:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323ebd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.549111:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323ebd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.549120:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec41bb93/0xcd6380150a323ebd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.549168:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788791689.549172:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323ec4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.549178:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791689.549182:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323ec4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.549189:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323ec4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.549198:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323ec4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.549205:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a323ec4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.549226:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791689.549229:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323ecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.549235:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791689.549239:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323ecb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.549245:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323ecb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.549255:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323ecb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.549262:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf1785c3/0xcd6380150a323ecb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.549272:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791689.549285:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791689.549287:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791689.549562:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.549570:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323ed2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.549576:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.549581:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.549710:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.549718:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323ed2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.549731:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323ed2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.549740:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323ed2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.549749:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323ed2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.550237:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791689.550449:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791689.550456:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323ed2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.550464:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791689.550475:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323ed2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.550937:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323ed2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.550955:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323ed2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.550962:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ba6a9bb/0xcd6380150a323ed2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.550987:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791689.550989:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791689.550991:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791689.552266:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791689.552777:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.552787:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323ed9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.552806:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.552811:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.552817:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323ed9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.552831:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323ed9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.552840:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323ed9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.552847:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323ed9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.553486:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791689.553503:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791689.553508:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323ed9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.553517:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ffa00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791689.553529:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323ed9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.553538:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323ed9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.553555:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323ed9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.553563:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094928b14/0xcd6380150a323ed9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.553583:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.553715:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.553719:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788791689.554466:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788791689.555229:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.555238:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032ef5fdb/0xcd6380150a323ee0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.555255:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.555260:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.555266:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032ef5fdb/0xcd6380150a323ee0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.555290:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032ef5fdb/0xcd6380150a323ee0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.555300:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032ef5fdb/0xcd6380150a323ee0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.555315:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032ef5fdb/0xcd6380150a323ee0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.555332:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791689.555344:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791689.555349:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032ef5fdb/0xcd6380150a323ee0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.555355:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fec00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791689.555359:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032ef5fdb/0xcd6380150a323ee0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.555367:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032ef5fdb/0xcd6380150a323ee0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.556714:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032ef5fdb/0xcd6380150a323ee0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.556724:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032ef5fdb/0xcd6380150a323ee0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.556746:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.556748:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.556751:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791689.557691:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.557703:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323ee7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.557713:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.557716:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.557721:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323ee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.557729:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323ee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.557734:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323ee7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.557739:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323ee7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.557759:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791689.557787:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791689.557794:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323ee7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.557961:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791689.557968:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323ee7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.557978:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323ee7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.557994:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323ee7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.558000:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a323ee7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.558019:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.558020:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.558022:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791689.558718:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.558727:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323eee lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.558738:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.558742:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.558747:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323eee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.558757:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323eee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.558772:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323eee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.558779:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323eee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.558816:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791689.558959:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791689.558967:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323eee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.558977:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791689.558982:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323eee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.558991:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323eee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.559015:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323eee lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.559023:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a323eee lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.559045:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791689.559046:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791689.559048:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791689.559292:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.559299:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a323ef5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.559308:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.559312:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.559316:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a323ef5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.559326:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a323ef5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.559334:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a323ef5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.559343:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a323ef5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.559380:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791689.559405:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791689.559411:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a323ef5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.559420:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851ca000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791689.559424:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a323ef5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.559433:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a323ef5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.559447:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a323ef5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.559454:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a323ef5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.559485:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791689.559488:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791689.559490:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791689.559775:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.559780:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3015e7e/0xcd6380150a323efc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.559789:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.559791:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.559795:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3015e7e/0xcd6380150a323efc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.559804:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3015e7e/0xcd6380150a323efc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.559811:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3015e7e/0xcd6380150a323efc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.559818:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3015e7e/0xcd6380150a323efc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.559840:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788791689.560265:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.560271:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000145a94ca/0xcd6380150a323f03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560292:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.560300:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.560305:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000145a94ca/0xcd6380150a323f03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560314:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000145a94ca/0xcd6380150a323f03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560321:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000145a94ca/0xcd6380150a323f03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560327:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000145a94ca/0xcd6380150a323f03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560345:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788791689.560356:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788791689.560360:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3015e7e/0xcd6380150a323efc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560368:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851cba00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791689.560372:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3015e7e/0xcd6380150a323efc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560380:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3015e7e/0xcd6380150a323efc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560392:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3015e7e/0xcd6380150a323efc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560409:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3015e7e/0xcd6380150a323efc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560426:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791689.560430:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000145a94ca/0xcd6380150a323f03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560436:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851ca800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791689.560440:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000145a94ca/0xcd6380150a323f03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560446:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000145a94ca/0xcd6380150a323f03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560457:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000145a94ca/0xcd6380150a323f03 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560464:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000145a94ca/0xcd6380150a323f03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560477:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.560480:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.560481:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791689.560915:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.560921:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d99a898/0xcd6380150a323f0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560934:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.560938:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.560942:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d99a898/0xcd6380150a323f0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560952:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d99a898/0xcd6380150a323f0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560960:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d99a898/0xcd6380150a323f0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.560967:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d99a898/0xcd6380150a323f0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791689.560975:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.560983:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791689.560994:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791689.560997:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d99a898/0xcd6380150a323f0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.561004:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851ca400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791689.561008:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d99a898/0xcd6380150a323f0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.561015:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d99a898/0xcd6380150a323f0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.561036:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d99a898/0xcd6380150a323f0a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.561043:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d99a898/0xcd6380150a323f0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.561055:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.561057:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.561059:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791689.564846:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.564862:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d39db273/0xcd6380150a323f11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.564879:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.564883:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.564889:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d39db273/0xcd6380150a323f11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.564902:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d39db273/0xcd6380150a323f11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.564913:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d39db273/0xcd6380150a323f11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.564921:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d39db273/0xcd6380150a323f11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.564999:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788791689.565541:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.565547:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f96b2bab/0xcd6380150a323f18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.565557:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.565561:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.565565:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f96b2bab/0xcd6380150a323f18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.565573:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f96b2bab/0xcd6380150a323f18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.565581:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f96b2bab/0xcd6380150a323f18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.565588:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f96b2bab/0xcd6380150a323f18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.565845:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788791689.565853:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d39db273/0xcd6380150a323f11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.565861:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851cb200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791689.565866:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d39db273/0xcd6380150a323f11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.565886:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d39db273/0xcd6380150a323f11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.565902:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d39db273/0xcd6380150a323f11 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.565910:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d39db273/0xcd6380150a323f11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.567332:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791689.567344:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f96b2bab/0xcd6380150a323f18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.567356:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851cb800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791689.567360:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f96b2bab/0xcd6380150a323f18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.567371:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f96b2bab/0xcd6380150a323f18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.567390:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f96b2bab/0xcd6380150a323f18 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.567399:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.567401:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.567410:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.567896:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788791689.567904:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f96b2bab/0xcd6380150a323f18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788791689.568811:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791689.568819:0:15043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000150688d4/0xcd6380150a323f1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.568838:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=465s v=(0 0) 00010000:00010000:0.0:1788791689.568843:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791689.568849:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000150688d4/0xcd6380150a323f1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.568863:0:15043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000150688d4/0xcd6380150a323f1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.568872:0:15043:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000150688d4/0xcd6380150a323f1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791689.568878:0:15043:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000150688d4/0xcd6380150a323f1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.568967:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791689.568974:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000150688d4/0xcd6380150a323f1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.568983:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851ca600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791689.568988:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000150688d4/0xcd6380150a323f1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.568997:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000150688d4/0xcd6380150a323f1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.569012:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000150688d4/0xcd6380150a323f1f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791689.569021:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.569022:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791689.569025:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791689.569292:0:15043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788791689.569298:0:15043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000150688d4/0xcd6380150a323f1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788791689.569553:0:15043:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1788791689.569855:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14384:x1875683630477696:12345-0@lo:5:osp-pre-0-0.0 Request processed in 99680us (99882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791689.569866:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788791689.569921:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14384:1875683630477696:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788791689.569936:0:14384:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788791689.569979:0:14384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14384:1875683630477824:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788791689.570023:0:14384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791689.570063:0:14384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba89179000 going to sleep for 11 seconds 00000100:00100000:0.0:1788791689.570081:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630477824 00000100:00100000:0.0:1788791689.570087:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630477824 00000100:00100000:0.0:1788791689.570143:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788791689.570153:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14384:x1875683630477824:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788791689.570187:0:15045:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1788791689.572705:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791689.577925:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14384:x1875683630477824:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7766us (7894us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788791689.577938:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788791689.577996:0:14384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14384:1875683630477824:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788791689.578012:0:14384:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00100000:2.0:1788791689.584295:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788791690.339821:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791691.368866:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791692.387403:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791693.411334:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791694.435491:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788791694.629849:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788791694.629858:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788791694.629863:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ababab12800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788791694.629874:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:0.0:1788791694.629880:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788791694.629888:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ababab12800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:0.0:1788791694.629915:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ababb82c000 x1875683630478208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788791694.629977:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630478464:0@lo:400:kworker.0 00000100:00100000:0.0:1788791694.630153:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791694.630265:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630478208:0@lo:8:kworker.0 00000100:00100000:0.0:1788791694.630299:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791694.630428:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788791694.630443:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630477952:0@lo:400:kworker.0 00000100:00100000:0.0:1788791694.630475:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791694.630513:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630477952 00000100:00100000:0.0:1788791694.630522:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630477952 00000100:00100000:0.0:1788791694.630579:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788791694.630589:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3058050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:3312:x1875683630477952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791694.630647:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3058050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:3312:x1875683630477952:12345-0@lo:400:kworker.0 Request processed in 58us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791694.630654:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788791694.630710:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630477952:0@lo:400:kworker.0 00000100:00100000:0.0:1788791694.635093:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788791694.635166:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630478592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791694.635284:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791694.635672:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630478080:0@lo:400:kworker.0 00000100:00100000:2.0:1788791694.635719:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791694.635761:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791694.635785:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630478336:0@lo:400:kworker.0 00000100:00100000:2.0:1788791694.635818:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791694.635860:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630478464 00000100:00100000:2.0:1788791694.635870:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630478464 00000100:00100000:2.0:1788791694.635934:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630478336 00000100:00100000:2.0:1788791694.635938:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630478336 00000100:00100000:2.0:1788791694.635955:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788791694.635963:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630478464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791694.636022:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630478464:12345-0@lo:400:kworker.0 Request processed in 59us (5897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791694.636029:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788791694.636047:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788791694.636052:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630478336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791694.636077:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630478336:12345-0@lo:400:kworker.0 Request processed in 25us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791694.636083:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788791694.636106:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630478208 00000100:00100000:2.0:1788791694.636109:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630478208 00000100:00100000:2.0:1788791694.636121:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630478080 00000100:00100000:2.0:1788791694.636123:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630478080 00000100:00100000:2.0:1788791694.636165:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791694.636170:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875683630478080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791694.636210:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3314:x1875683630478080:12345-0@lo:400:kworker.0 Request processed in 39us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791694.636217:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791694.636227:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788791694.636231:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3311:x1875683630478208:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788791694.636259:0:15046:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:1.0:1788791694.637224:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababb82dc00 x1875683630478464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791694.637242:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630478464:0@lo:400:kworker.0 00000100:00080000:3.0:1788791694.662662:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788791694.662677:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788791694.662718:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630478592 00000100:00100000:3.0:1788791694.662744:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630478592 00000100:00100000:3.0:1788791694.662826:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788791694.662840:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875683630478592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788791694.662894:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791694.663021:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875683630478592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (27736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791694.663029:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788791694.663102:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababb82d180 x1875683630478336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791694.663155:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630478336:0@lo:400:kworker.0 00000100:00100000:3.0:1788791694.663315:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630478592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788791694.666011:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630478080:0@lo:400:kworker.0 00000100:00100000:3.0:1788791694.666319:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3311:x1875683630478208:12345-0@lo:8:kworker.0 Request processed in 30077us (36009us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788791694.666344:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788791694.666416:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ababab12800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788791694.666423:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788791694.666427:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630478208:0@lo:8:kworker.0 00000020:01000004:1.0:1788791694.772586:0:15759:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788791694.772593:0:15759:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788791694.772773:0:15759:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9abab2989800 00000020:01000004:1.0:1788791694.772799:0:15759:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788791694.772816:0:15759:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788791694.772835:0:15759:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9aba88c63370) 00000020:00000080:1.0:1788791694.772880:0:15759:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00000001:00080000:1.0:1788791694.795911:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00100000:10000000:3.0:1788791694.807439:0:15759:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788791694.807794:0:15759:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788791694.809007:0:15759:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788791694.809279:0:15759:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788791694.809490:0:15759:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788791694.810732:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 499: rc = 0 00100000:10000000:3.0:1788791694.810837:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 499: rc = 0 00100000:10000000:3.0:1788791694.810936:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 499: rc = 0 00100000:10000000:3.0:1788791694.811808:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 648: rc = 0 00100000:10000000:3.0:1788791694.812067:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 648: rc = 0 00100000:10000000:2.0:1788791694.812596:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 648: rc = 0 00100000:10000000:2.0:1788791694.812865:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 648: rc = 0 00100000:10000000:2.0:1788791694.813116:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 648: rc = 0 00100000:10000000:2.0:1788791694.813410:0:15759:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 648: rc = 0 00000020:00000080:2.0:1788791694.813945:0:15759:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788791694.813959:0:15759:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788791694.813970:0:15759:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd6380150a323f2d 00000020:01000004:2.0:1788791694.813979:0:15759:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788791694.813999:0:15759:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788791694.814002:0:15759:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788791694.814007:0:15759:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788791694.814027:0:15759:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788791694.814032:0:15759:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788791694.839095:0:15759:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.129@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788791694.839172:0:15759:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.129@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788791694.839176:0:15759:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788791694.839178:0:15759:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788791694.839179:0:15759:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788791694.839191:0:15759:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788791694.839193:0:15759:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788791694.839194:0:15759:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788791694.839195:0:15759:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788791694.839197:0:15759:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788791694.839198:0:15759:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788791694.839208:0:15759:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788791694.839210:0:15759:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788791694.839211:0:15759:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788791694.839211:0:15759:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788791694.839212:0:15759:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788791694.839213:0:15759:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788791694.839214:0:15759:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788791694.839215:0:15759:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788791694.839216:0:15759:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788791694.839217:0:15759:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788791694.839255:0:15759:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788791694.839274:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630478720:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788791694.839344:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791694.839417:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98dffe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788791694.839615:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630478720 00000100:00100000:0.0:1788791694.839624:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630478720 00000100:00100000:0.0:1788791694.839693:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788791694.839705:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3058c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:15759:x1875683630478720:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788791694.839738:0:14356:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788791694.839741:0:14356:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788791694.839746:0:14356:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788791694.862905:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3058c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:15759:x1875683630478720:12345-0@lo:253:mount.lustre.0 Request processed in 23192us (23550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791694.862922:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788791694.862967:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630478720:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788791694.862984:0:15759:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788791694.862988:0:15759:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788791694.862989:0:15759:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788791694.862990:0:15759:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788791694.862991:0:15759:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788791694.862993:0:15759:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788791694.862994:0:15759:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788791694.862995:0:15759:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788791694.862997:0:15759:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788791694.862998:0:15759:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788791694.863019:0:15759:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9abab2989800 from lustre-OST0001 10000000:01000000:2.0:1788791694.863045:0:15759:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788791694.863048:0:15759:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788791694.863056:0:15759:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9abab3e38000 local copy 00010000:00010000:2.0:1788791694.863066:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c800/0xcd6380150a323cd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323cda expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791694.863331:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630478848:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788791694.863467:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791694.863523:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630478848 00000100:00100000:2.0:1788791694.863526:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98dff0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791694.863530:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630478848 00000100:00100000:0.0:1788791694.863618:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788791694.863631:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3059050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:15759:x1875683630478848:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791694.864073:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3059050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:15759:x1875683630478848:12345-0@lo:501:mount.lustre.0 Request processed in 443us (604us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788791694.864082:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788791694.864169:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630478848:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788791694.864194:0:15759:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788791694.864339:0:15759:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788791694.864347:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c800/0xcd6380150a323cd3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323cda expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791694.864483:0:15759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb16c800/0xcd6380150a323cd3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323cda expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791694.864523:0:15759:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9abab2989800 10000000:01000000:2.0:1788791694.864528:0:15759:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788791694.864534:0:15759:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788791694.864537:0:15759:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788791694.864541:0:15759:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788791694.864544:0:15759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788791694.864569:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb81b200/0xcd6380150a323f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791694.864578:0:15759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb81b200/0xcd6380150a323f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791694.864588:0:15759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb81b200/0xcd6380150a323f34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791694.864604:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630478976:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788791694.864637:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791694.864673:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98dff0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791694.865503:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630478976 00000100:00100000:1.0:1788791694.865513:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630478976 00000100:00100000:1.0:1788791694.865566:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788791694.865578:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab305a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:15759:x1875683630478976:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788791694.865591:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791694.865606:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9abab2c00200/0xcd6380150a323f3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a323f34 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791694.865631:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9abab2c00200/0xcd6380150a323f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a323f34 expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791694.865642:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9abab2c00200/0xcd6380150a323f3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323f34 expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791694.865652:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9abab2c00200, rc 0) 00000100:00100000:1.0:1788791694.865716:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab305a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:15759:x1875683630478976:12345-0@lo:101:mount.lustre.0 Request processed in 141us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791694.865724:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788791694.865968:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630478976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788791694.865997:0:15759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb81b200/0xcd6380150a323f34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323f3b expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791694.866007:0:15759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb81b200/0xcd6380150a323f34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323f3b expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788791694.867339:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788791694.870824:0:15759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788791694.871789:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788791694.871836:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788791694.872315:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788791694.872608:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788791694.872639:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788791694.872664:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788791694.872720:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788791694.872727:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788791694.872825:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630479104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788791694.873780:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791694.873899:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98dffa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788791694.879718:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630479104 00000100:00100000:1.0:1788791694.879734:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630479104 00000100:00100000:3.0:1788791694.890200:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788791694.890226:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7a01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:15759:x1875683630479104:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788791694.890792:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7a01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:15759:x1875683630479104:12345-0@lo:501:mount.lustre.0 Request processed in 577us (17012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791694.890802:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788791694.890942:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630479104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788791694.890994:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630479232:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788791694.891044:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791694.891471:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98dffa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788791694.891690:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630479232 00000100:00100000:1.0:1788791694.891698:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630479232 00000100:00100000:2.0:1788791694.895545:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788791694.895558:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7a00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:15759:x1875683630479232:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788791694.895981:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7a00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:15759:x1875683630479232:12345-0@lo:503:mount.lustre.0 Request processed in 424us (4936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791694.895999:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788791694.896601:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb040a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630479232:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788791694.898234:0:15759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788791694.898317:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630479360:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788791694.898450:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791694.898580:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ab9811f1840 going to sleep for 11 seconds 00000100:00100000:3.0:1788791694.901058:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630479360 00000100:00100000:3.0:1788791694.901076:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630479360 00000100:00100000:2.0:1788791694.901628:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788791694.901643:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7a01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:15759:x1875683630479360:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788791694.902196:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7a01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:15759:x1875683630479360:12345-0@lo:502:mount.lustre.0 Request processed in 557us (3745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791694.902204:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788791694.902651:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630479360:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788791694.906658:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788791694.906748:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788791694.906783:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788791694.906832:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788791694.907474:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788791694.907598:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788791694.907661:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788791694.907697:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788791694.907745:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788791694.907797:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630479488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788791694.908593:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791694.908690:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba99510600 going to sleep for 11 seconds 00000100:00100000:0.0:1788791694.914481:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630479488 00000100:00100000:0.0:1788791694.914996:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630479488 00000100:00100000:2.0:1788791694.918774:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788791694.918790:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7a01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:15759:x1875683630479488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788791694.920040:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7a01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:15759:x1875683630479488:12345-0@lo:502:mount.lustre.0 Request processed in 1249us (11444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791694.920051:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788791694.920221:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630479488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788791694.920338:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788791694.920355:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1788791694.921404:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788791694.921413:0:15762:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788791694.921421:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788791694.921423:0:15762:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788791694.921430:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788791694.921446:0:15762:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9ababb06b370) 00000020:00000080:0.0:1788791694.921467:0:15762:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788791694.921473:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788791694.921563:0:15762:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9abab2989800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788791694.921570:0:15762:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788791694.921579:0:15762:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd6380150a323f49 00010000:00010000:1.0:1788791694.932674:0:15762:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788791694.933837:0:15762:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1788791694.938347:0:15762:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788791694.946740:0:15762:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788791694.946755:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788791694.946762:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791694.946764:0:15762:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788791694.946767:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788791694.946771:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791694.946773:0:15762:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788791694.946776:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788791694.946778:0:15762:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788791694.946781:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788791694.946783:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791694.946785:0:15762:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788791694.946787:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788791694.946789:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791694.946790:0:15762:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788791694.946794:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788791694.946938:0:15762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788791694.946943:0:15762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788791694.946944:0:15762:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788791694.946947:0:15762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788791694.951470:0:15759:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788791694.951953:0:15759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788791694.953661:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb81b200/0xcd6380150a323f34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323f3b expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791694.953678:0:15759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb81b200/0xcd6380150a323f34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323f3b expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791694.954190:0:15759:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9abab2989800 from 1 10000000:01000000:2.0:1788791694.954195:0:15759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788791694.954234:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb81ae00/0xcd6380150a323f50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791694.954242:0:15759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb81ae00/0xcd6380150a323f50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791694.954254:0:15759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb81ae00/0xcd6380150a323f50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791694.954277:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb041500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630479616:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788791694.954341:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791694.954816:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba98dffc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788791694.954874:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630479616 00000100:00100000:0.0:1788791694.954881:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630479616 00000100:00100000:0.0:1788791694.954946:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788791694.954955:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7a00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:15759:x1875683630479616:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788791694.954969:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791694.954982:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba851cbe00/0xcd6380150a323f57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a323f50 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791694.955005:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba851cbe00/0xcd6380150a323f57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a323f50 expref: 18 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791694.955016:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba851cbe00/0xcd6380150a323f57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323f50 expref: 18 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791694.955025:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba851cbe00, rc 0) 00000100:00100000:0.0:1788791694.955071:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7a00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:15759:x1875683630479616:12345-0@lo:101:mount.lustre.0 Request processed in 117us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791694.955078:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788791694.958641:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb041500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630479616:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788791694.958680:0:15759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb81ae00/0xcd6380150a323f50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323f57 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791694.958693:0:15759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb81ae00/0xcd6380150a323f50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323f57 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788791694.959270:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788791694.959569:0:15759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788791694.959754:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788791694.959793:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788791694.959853:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788791694.959861:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788791694.959926:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630479744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788791694.959985:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791694.960022:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ab9811f1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788791694.960396:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630479744 00000100:00100000:2.0:1788791694.960411:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630479744 00000100:00100000:2.0:1788791694.960464:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788791694.960474:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7a02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:15759:x1875683630479744:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788791694.960693:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7a02050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:15759:x1875683630479744:12345-0@lo:501:mount.lustre.0 Request processed in 220us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791694.960701:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788791694.961288:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630479744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788791694.961328:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630479872:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788791694.961373:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791694.961401:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ab9811f1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788791694.961666:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630479872 00000100:00100000:2.0:1788791694.961672:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630479872 00000100:00100000:2.0:1788791694.961715:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788791694.961723:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7a03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:15759:x1875683630479872:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788791694.962200:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7a03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:15759:x1875683630479872:12345-0@lo:503:mount.lustre.0 Request processed in 476us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791694.962207:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788791694.962449:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630479872:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788791694.964107:0:15759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788791694.964305:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630480000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788791694.964473:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791694.964584:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ab9811f1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788791694.964819:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630480000 00000100:00100000:0.0:1788791694.964827:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630480000 00000100:00100000:0.0:1788791694.964885:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788791694.964895:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:15759:x1875683630480000:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788791694.965160:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:15759:x1875683630480000:12345-0@lo:502:mount.lustre.0 Request processed in 265us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791694.965168:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788791694.965412:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630480000:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788791694.965807:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788791694.965873:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788791694.965929:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788791694.965968:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788791694.966002:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788791694.966054:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788791694.966089:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788791694.966118:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788791694.966306:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630480128:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788791694.966381:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791694.966460:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ab9811f1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788791694.967085:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630480128 00000100:00100000:2.0:1788791694.967093:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630480128 00000100:00100000:2.0:1788791694.967708:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788791694.967721:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:15759:x1875683630480128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788791694.967973:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:15759:x1875683630480128:12345-0@lo:502:mount.lustre.0 Request processed in 255us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791694.967982:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788791694.968071:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d50a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630480128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788791694.968269:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788791694.968283:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788791694.969395:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791694.969407:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791694.969409:0:15766:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788791694.969423:0:15766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9abab2989800 00000020:00000080:3.0:1788791694.969426:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788791694.969434:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791694.969436:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791694.969437:0:15766:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788791694.969440:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791694.969442:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791694.969443:0:15766:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788791694.969446:0:15766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9abab2989800 00000020:00000080:3.0:1788791694.969448:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788791694.969510:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791694.969514:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791694.969515:0:15766:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788791694.969517:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788791694.969519:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791694.969521:0:15766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788791694.969523:0:15766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9abab2989800 00000020:00000080:3.0:1788791694.969525:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788791694.969561:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788791694.969564:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788791694.969565:0:15766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788791694.969567:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788791694.977149:0:15759:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788791694.977204:0:15759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788791694.977229:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb81ae00/0xcd6380150a323f50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323f57 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791694.977242:0:15759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb81ae00/0xcd6380150a323f50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323f57 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791694.977308:0:15759:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788791694.977311:0:15759:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9abab2989800 10000000:01000000:0.0:1788791694.977314:0:15759:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9abab2989800 10000000:01000000:0.0:1788791694.977318:0:15759:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788791694.977325:0:15759:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9abab2989800 from 1 10000000:01000000:0.0:1788791694.977329:0:15759:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788791694.977367:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851caa00/0xcd6380150a323f5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791694.977375:0:15759:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba851caa00/0xcd6380150a323f5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791694.977388:0:15759:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba851caa00/0xcd6380150a323f5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791694.977415:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630480256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788791694.977480:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791694.977621:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630480256 00000100:00100000:2.0:1788791694.977630:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630480256 00000100:00100000:2.0:1788791694.977673:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788791694.977682:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:15759:x1875683630480256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788791694.977695:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791694.977709:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb81a000/0xcd6380150a323f65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a323f5e expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791694.977746:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb81a000/0xcd6380150a323f65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a323f5e expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791694.977756:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb81a000/0xcd6380150a323f65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323f5e expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791694.977766:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81a000, rc 0) 00000100:00100000:2.0:1788791694.981664:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:15759:x1875683630480256:12345-0@lo:101:mount.lustre.0 Request processed in 3973us (4174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791694.981677:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788791694.982003:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba997df240 going to sleep for 11 seconds 00000100:00100000:0.0:1788791694.982028:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630480256:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788791694.982050:0:15759:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba851caa00/0xcd6380150a323f5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323f65 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791694.982062:0:15759:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba851caa00/0xcd6380150a323f5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323f65 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788791694.985737:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788791694.987591:0:15759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788791694.989048:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788791694.996123:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788791694.996246:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788791694.996312:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788791694.996344:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788791694.996394:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788791694.996430:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788791694.996463:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788791694.996512:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788791694.996567:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788791694.996597:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788791694.996638:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788791694.996668:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788791694.996694:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788791694.996735:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788791694.996772:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788791694.996806:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788791694.996855:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788791694.996889:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788791694.996922:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788791694.996970:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788791694.997007:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788791694.997041:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788791694.997089:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788791694.997153:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788791694.999680:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788791694.999783:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788791694.999822:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788791694.999868:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788791694.999917:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1788791694.999952:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1788791694.999984:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1788791695.000018:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1788791695.000066:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1788791695.000119:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1788791695.000206:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1788791695.000249:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1788791695.000346:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1788791695.000354:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788791695.000463:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630480384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791695.000543:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791695.000594:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630480384 00000100:00100000:0.0:1788791695.000600:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630480384 00000100:00100000:0.0:1788791695.000644:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788791695.000652:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:15759:x1875683630480384:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791695.000865:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:15759:x1875683630480384:12345-0@lo:501:mount.lustre.0 Request processed in 212us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791695.000873:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788791695.000918:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba997df240 going to sleep for 11 seconds 00000100:00100000:0.0:1788791695.000939:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630480384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788791695.000972:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630480512:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788791695.001012:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791695.001034:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630480512 00000100:00100000:0.0:1788791695.001038:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630480512 00000100:00100000:0.0:1788791695.001058:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788791695.001064:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:15759:x1875683630480512:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788791695.001370:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:15759:x1875683630480512:12345-0@lo:503:mount.lustre.0 Request processed in 305us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791695.001376:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788791695.001409:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba997df240 going to sleep for 11 seconds 00000100:00100000:0.0:1788791695.001422:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630480512:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788791695.001887:0:15759:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788791695.001956:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630480640:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788791695.001999:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791695.002030:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630480640 00000100:00100000:0.0:1788791695.002035:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630480640 00000100:00100000:0.0:1788791695.002064:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788791695.002069:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:15759:x1875683630480640:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788791695.002333:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:15759:x1875683630480640:12345-0@lo:502:mount.lustre.0 Request processed in 263us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791695.002340:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788791695.002379:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba997df240 going to sleep for 11 seconds 00000100:00100000:0.0:1788791695.002394:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630480640:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788791695.002639:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788791695.002679:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788791695.002704:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788791695.002740:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788791695.002767:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788791695.002826:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788791695.002864:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788791695.002898:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788791695.002956:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788791695.002996:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788791695.003030:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788791695.003074:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788791695.003105:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788791695.003166:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788791695.017100:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788791695.017199:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788791695.017251:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788791695.017291:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788791695.017317:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788791695.017341:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788791695.017382:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788791695.017414:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788791695.017440:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788791695.017477:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788791695.017520:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788791695.017546:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788791695.017582:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788791695.017610:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788791695.017633:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788791695.017666:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788791695.017692:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788791695.017717:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788791695.017757:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788791695.017813:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788791695.017850:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788791695.017894:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788791695.017929:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788791695.017959:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788791695.018020:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788791695.018062:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788791695.018113:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630480768:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788791695.018229:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791695.018276:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630480768 00000100:00100000:0.0:1788791695.018283:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630480768 00000100:00100000:0.0:1788791695.018327:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788791695.018335:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:15759:x1875683630480768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788791695.018537:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:15759:x1875683630480768:12345-0@lo:502:mount.lustre.0 Request processed in 202us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791695.018551:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788791695.018606:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba997df240 going to sleep for 11 seconds 00000100:00100000:0.0:1788791695.018628:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630480768:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788791695.018694:0:15759:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788791695.018704:0:15759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788791695.032912:0:15771:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788791695.032932:0:15771:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9ababc148000) 00000020:00000080:2.0:1788791695.032955:0:15771:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788791695.033046:0:15771:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9abab2989800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788791695.033050:0:15771:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9abab2989800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788791695.033052:0:15771:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9abab2989800 3 00010000:00080000:2.0:1788791695.033081:0:15771:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9ab983749000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.129@tcp at head 00010000:00010000:2.0:1788791695.034759:0:15771:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788791695.036436:0:15771:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788791695.036473:0:15771:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788791695.036485:0:15771:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcd6380150a323f73 00000100:00080000:2.0:1788791695.036626:0:15771:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788791695.036632:0:15771:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9ab983749000 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:2.0:1788791695.036690:0:15771:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9ababb042680 x1875683630480896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788791695.036745:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875683630480896:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788791695.036837:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791695.036924:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630480896 00000100:00100000:0.0:1788791695.036932:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630480896 00000100:00100000:0.0:1788791695.036969:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788791695.036976:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1875683630480896:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788791695.036999:0:14362:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:0.0:1788791695.037028:0:14362:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcd6380150a323f7a 00000004:00100000:0.0:1788791695.037040:0:14362:0:(mdt_handler.c:7335:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788791695.037070:0:14362:0:(import.c:65:import_set_state_nolock()) ffff9abaa70e0800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788791695.037218:0:15771:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788791695.040387:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875683630480896:12345-0@lo:38:llog_process_th.0 Request processed in 3400us (3539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791695.040399:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:1.0:1788791695.045223:0:15771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1788791695.045592:0:15759:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788791695.045625:0:15759:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788791695.045682:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851caa00/0xcd6380150a323f5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323f65 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.045695:0:15759:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba851caa00/0xcd6380150a323f5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323f65 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788791695.045745:0:15759:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788791695.045749:0:15759:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788791695.045750:0:15759:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791695.045755:0:15759:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791695.045756:0:15759:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791695.045758:0:15759:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791695.045759:0:15759:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788791695.045778:0:15759:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791695.045780:0:15759:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788791695.045784:0:15759:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788791695.045793:0:15759:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788791695.045794:0:15759:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788791695.045795:0:15759:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791695.045796:0:15759:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791695.045797:0:15759:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791695.045798:0:15759:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791695.045799:0:15759:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788791695.045800:0:15759:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791695.045801:0:15759:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788791695.045826:0:15759:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788791695.045845:0:15759:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630481024:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788791695.045988:0:15759:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791695.046036:0:15759:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba997df9c0 going to sleep for 11 seconds 00010000:00080000:3.0:1788791695.047521:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9ababb042680 x1875683630480896/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788791705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791695.047537:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788791695.047545:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788791695.047553:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788791695.047558:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788791695.047562:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ab983749000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788791695.047577:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875683630480896:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788791695.047913:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630481024 00000100:00100000:1.0:1788791695.047922:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630481024 00000100:00100000:1.0:1788791695.048197:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788791695.048208:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:15759:x1875683630481024:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788791695.048240:0:14356:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788791695.048256:0:14356:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788791695.101702:0:14356:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788791695.101725:0:14356:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788791695.101795:0:14377:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788791695.101801:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788791695.101824:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ababb16d600/0xcd6380150a323f81 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791695.101856:0:14377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ababb16cc00/0xcd6380150a323e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323e4d expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791695.101865:0:14377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ababb16d600/0xcd6380150a323f81 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791695.101914:0:14377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ababb16cc00/0xcd6380150a323e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a323e4d expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791695.101931:0:14377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ababb16cc00/0xcd6380150a323e54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a323e4d expref: 19 pid: 14355 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791695.101946:0:14377:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14377:1875683630481152:0@lo:104: 00000100:00100000:3.0:1788791695.102011:0:14377:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791695.102060:0:14377:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab78da000 going to sleep for 11 seconds 00000100:00100000:0.0:1788791695.102166:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630481152 00000100:00100000:0.0:1788791695.102174:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630481152 00000100:00100000:0.0:1788791695.102233:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788791695.102243:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+3:14377:x1875683630481152:12345-0@lo:104: 00010000:00010000:0.0:1788791695.102256:0:14344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9ababb16d400/0xcd6380150a323e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a323e54 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.102314:0:14344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788791695.102320:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+3:14377:x1875683630481152:12345-0@lo:104: Request processed in 79us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791695.102326:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788791695.102348:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791695.102367:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9ababb16d400/0xcd6380150a323e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a323e54 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.102374:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d400 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791695.102378:0:14350:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16d400/0xcd6380150a323e4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a323e54 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.102387:0:14350:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9ababb16d400/0xcd6380150a323e4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a323e54 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791695.102394:0:14350:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16d400/0xcd6380150a323e4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a323e54 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791695.102400:0:14350:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788791695.102432:0:14350:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9ababb16d400/0xcd6380150a323e4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323e54 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.102438:0:14350:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788791695.102456:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9ababb16d400/0xcd6380150a323e4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323e54 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.102462:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9ababb16d400/0xcd6380150a323e4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323e54 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.102478:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791695.102480:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791695.102481:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791695.102582:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa113159-ee5b-4f24-93ba-c8c094c83d87:3314:1875683630481280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788791695.102614:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791695.102660:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630481280 00000100:00100000:0.0:1788791695.102671:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630481280 00010000:00010000:0.0:1788791695.102692:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ababb16cc00/0xcd6380150a323e54 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a323e4d expref: 20 pid: 14355 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791695.102719:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788791695.102728:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+20:3314:x1875683630481280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788791695.102740:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788791695.102746:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ababb16cc00/0xcd6380150a323e54 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a323e4d expref: 20 pid: 14355 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.102756:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ababb16cc00/0xcd6380150a323e54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a323e4d expref: 20 pid: 14355 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.102774:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ababb16d600/0xcd6380150a323f81 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.102782:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16d600/0xcd6380150a323f81 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788791695.102795:0:14346:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003133781s 00010000:00010000:0.0:1788791695.102799:0:14346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ababb16d600/0xcd6380150a323f81 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.102806:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ababb16d600/0xcd6380150a323f81 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.102813:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ababb16d600/0xcd6380150a323f81 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.102821:0:14346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ababb16d600/0xcd6380150a323f81 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.102838:0:14346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791695.102842:0:14346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ababb16d600/0xcd6380150a323f81 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.102850:0:14346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ababb16d600/0xcd6380150a323f81 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.102858:0:14346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ababb16d600/0xcd6380150a323f81 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.102869:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788791695.102901:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+20:3314:x1875683630481280:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791695.102908:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788791695.102941:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa113159-ee5b-4f24-93ba-c8c094c83d87:3314:1875683630481280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788791695.102967:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16cc00/0xcd6380150a323e54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a323e4d expref: 19 pid: 14355 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791695.102977:0:14377:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14377:1875683630481152:0@lo:104: 00010000:00010000:0.0:1788791695.102990:0:14377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ababb16d600/0xcd6380150a323f81 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.102999:0:14377:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ababb16d600/0xcd6380150a323f81 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.103005:0:14377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ababb16d600/0xcd6380150a323f81 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791695.103021:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16d600/0xcd6380150a323f81 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791695.122631:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:15759:x1875683630481024:12345-0@lo:253:mount.lustre.0 Request processed in 74416us (76634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791695.122646:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788791695.122733:0:15759:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:aa113159-ee5b-4f24-93ba-c8c094c83d87:15759:1875683630481024:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788791695.122749:0:15759:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788791695.122753:0:15759:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788791695.122755:0:15759:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788791695.122756:0:15759:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788791695.122757:0:15759:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788791695.122758:0:15759:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788791695.122760:0:15759:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788791695.122761:0:15759:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788791695.122763:0:15759:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788791695.122764:0:15759:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788791695.122781:0:15759:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788791695.129705:0:15759:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788791695.129973:0:15759:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788791695.130202:0:15759:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788791695.130369:0:15759:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788791695.130526:0:15759:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788791695.130757:0:15759:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788791695.131658:0:15759:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788791695.226218:0:15759:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788791695.226228:0:15759:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788791695.226264:0:15759:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788791695.226328:0:15759:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788791695.226347:0:15759:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788791695.226380:0:15759:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788791695.462955:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791696.485085:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788791696.997070:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788791697.062503:0:14358:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788791697.062512:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9aba89374800 from 8 10000000:01000000:3.0:1788791697.062517:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788791697.062571:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791697.062583:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791697.062595:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791697.062631:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630481408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788791697.062713:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791697.062765:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab78da480 going to sleep for 11 seconds 00000100:00100000:0.0:1788791697.064563:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630481408 00000100:00100000:0.0:1788791697.064577:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630481408 00000100:00100000:0.0:1788791697.064645:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788791697.064656:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:14358:x1875683630481408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788791697.064672:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791697.064690:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba851cb600/0xcd6380150a323f8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a323f88 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791697.065596:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba851cb600/0xcd6380150a323f8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a323f88 expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791697.065608:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba851cb600/0xcd6380150a323f8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323f88 expref: 19 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791697.065618:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba851cb600, rc 0) 00000100:00100000:0.0:1788791697.066626:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:14358:x1875683630481408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1047us (2988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791697.066639:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788791697.067826:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630481408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788791697.067853:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323f8f expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791697.067866:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a323f8f expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791697.067937:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630481536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788791697.067997:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791697.070275:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbcc7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788791697.078609:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630481536 00000100:00100000:3.0:1788791697.078625:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630481536 00000100:00100000:3.0:1788791697.078680:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788791697.078690:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab29c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:14358:x1875683630481536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788791697.078793:0:14356:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788791697.078816:0:14356:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788791697.078819:0:14356:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788791697.078937:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab29c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:14358:x1875683630481536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 248us (10939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791697.078946:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788791697.079632:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630481536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788791697.079710:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788791697.079732:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323f8f expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791697.079743:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb16de00/0xcd6380150a323f88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a323f8f expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791697.507283:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791698.531317:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791699.556697:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791699.752633:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630481664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791699.753053:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791699.758187:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630481664 00000100:00100000:1.0:1788791699.758202:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630481664 00000100:00100000:1.0:1788791699.758279:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788791699.758290:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630481664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788791699.758341:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791699.758452:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630481664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (5398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791699.758460:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788791699.758487:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788791699.758519:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788791699.758545:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630481664:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788791700.265750:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788791700.265758:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788791700.265761:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ababab12800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788791700.265771:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 471 00000100:00080000:1.0:1788791700.265775:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788791700.265782:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9ababab12800 using connection 192.168.201.129@tcp/0@lo 00000100:00100000:1.0:1788791700.265805:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9abab2d52680 x1875683630481920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788791700.265868:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630482048:0@lo:400:kworker.0 00000100:00100000:1.0:1788791700.265943:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791700.266002:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788791700.266008:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa113159-ee5b-4f24-93ba-c8c094c83d87:3313:1875683630481792:0@lo:400:kworker.0 00000100:00100000:1.0:1788791700.266036:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791700.266064:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630482176:0@lo:400:kworker.0 00000100:00100000:1.0:1788791700.266084:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791700.266114:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788791700.266118:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630482304:0@lo:400:kworker.0 00000100:00100000:1.0:1788791700.266165:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791700.266193:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630481792 00000100:00100000:1.0:1788791700.266212:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630481792 00000100:00100000:1.0:1788791700.266251:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788791700.266259:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3313:x1875683630481792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791700.266306:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99371050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3313:x1875683630481792:12345-0@lo:400:kworker.0 Request processed in 48us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791700.266314:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788791700.266563:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630482048 00000100:00100000:1.0:1788791700.266568:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630482048 00000100:00100000:1.0:1788791700.266591:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630482176 00000100:00100000:1.0:1788791700.266593:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630482176 00000100:00100000:1.0:1788791700.266618:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630482304 00000100:00100000:1.0:1788791700.266621:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630482304 00000100:00100000:1.0:1788791700.266633:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788791700.266639:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630482048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791700.266673:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875683630482048:12345-0@lo:400:kworker.0 Request processed in 34us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791700.266679:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788791700.266692:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788791700.266698:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630482176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791700.266729:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630482176:12345-0@lo:400:kworker.0 Request processed in 32us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791700.266736:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788791700.266748:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788791700.266755:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630482304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791700.266781:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630482304:12345-0@lo:400:kworker.0 Request processed in 27us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791700.266786:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788791700.266811:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788791700.266839:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab2d53b80 x1875683630482304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791700.266852:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630482304:0@lo:400:kworker.0 00010000:00080000:1.0:1788791700.266862:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab2d50700 x1875683630482176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791700.266870:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630482176:0@lo:400:kworker.0 00000100:00100000:1.0:1788791700.266903:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa113159-ee5b-4f24-93ba-c8c094c83d87:3313:1875683630481792:0@lo:400:kworker.0 00010000:00080000:1.0:1788791700.266913:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab2d51880 x1875683630482048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788791716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788791700.266920:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875683630482048:0@lo:400:kworker.0 00000100:00100000:3.0:1788791700.267081:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630481920:0@lo:8:kworker.0 00000100:00100000:3.0:1788791700.267155:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791700.267192:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630481920 00000100:00100000:3.0:1788791700.267196:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630481920 00000100:00100000:3.0:1788791700.267214:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788791700.267219:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875683630481920:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788791700.267242:0:15045:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 476 last 0 00000020:00000080:3.0:1788791700.267271:0:15045:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd6380150a323f96 00002000:00100000:3.0:1788791700.267283:0:15045:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9abaa9b39800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113952 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788791700.267287:0:15045:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788791700.267290:0:15045:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788791700.267642:0:15045:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788791700.267672:0:15045:0:(import.c:65:import_set_state_nolock()) ffff9abaa9b3c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788791700.267715:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875683630481920:12345-0@lo:8:kworker.0 Request processed in 494us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791700.267722:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788791700.267768:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9abab2d52680 x1875683630481920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788791725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788791700.267777:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788791700.267782:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788791700.267790:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788791700.267795:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788791700.267797:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9ababab12800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788791700.267809:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788791700.267813:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875683630481920:0@lo:8:kworker.0 00000004:00080000:3.0:1788791700.267855:0:14386:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788791700.267869:0:14386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14386:1875683630482560:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788791700.267892:0:14386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791700.267906:0:14386:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba857b2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788791700.267918:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630482560 00000100:00100000:3.0:1788791700.267921:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630482560 00000100:00100000:3.0:1788791700.267949:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788791700.267954:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14386:x1875683630482560:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788791700.270335:0:14385:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788791700.270697:0:14385:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 476650569373ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788791700.272148:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630482432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791700.272219:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791700.278557:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630482432 00000100:00100000:2.0:1788791700.278573:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630482432 00000100:00100000:2.0:1788791700.278641:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788791700.278652:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875683630482432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788791700.278690:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791700.278777:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb043100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875683630482432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (6556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791700.278785:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788791700.278833:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9ab982a3ed80 x1875683630482432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788791716 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788791700.278854:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630482432:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788791700.279176:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1788791700.279390:0:15046:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788791700.279398:0:15046:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788791700.279404:0:15046:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1788791700.296786:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791700.296799:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4d13118/0xcd6380150a323f9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.296824:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1788791700.296828:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791700.296836:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4d13118/0xcd6380150a323f9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.296854:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4d13118/0xcd6380150a323f9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.296865:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4d13118/0xcd6380150a323f9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.296873:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4d13118/0xcd6380150a323f9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.296901:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788791700.297613:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791700.297620:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323fa4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.297632:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1788791700.297635:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791700.297639:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.297650:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.297669:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323fa4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.297676:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.297692:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788791700.297704:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788791700.297709:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4d13118/0xcd6380150a323f9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.297717:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791700.297722:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4d13118/0xcd6380150a323f9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.297731:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4d13118/0xcd6380150a323f9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.297748:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4d13118/0xcd6380150a323f9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.297756:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4d13118/0xcd6380150a323f9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.297772:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791700.297782:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.297788:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791700.297792:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323fa4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.297799:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323fa4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.297810:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323fa4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.297817:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd809e6b/0xcd6380150a323fa4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.297828:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791700.297830:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791700.297831:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791700.298278:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791700.298284:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa200129/0xcd6380150a323fab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298294:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1788791700.298297:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791700.298301:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa200129/0xcd6380150a323fab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298321:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa200129/0xcd6380150a323fab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298329:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa200129/0xcd6380150a323fab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298336:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa200129/0xcd6380150a323fab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298350:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791700.298359:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791700.298363:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa200129/0xcd6380150a323fab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298369:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791700.298372:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa200129/0xcd6380150a323fab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298379:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa200129/0xcd6380150a323fab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298389:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa200129/0xcd6380150a323fab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298395:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa200129/0xcd6380150a323fab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298414:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791700.298416:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791700.298418:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788791700.298803:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788791700.298808:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ca2a1b4/0xcd6380150a323fb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298817:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1788791700.298819:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791700.298824:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ca2a1b4/0xcd6380150a323fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298833:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ca2a1b4/0xcd6380150a323fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298840:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ca2a1b4/0xcd6380150a323fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298846:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ca2a1b4/0xcd6380150a323fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298860:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791700.298868:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791700.298871:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ca2a1b4/0xcd6380150a323fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298889:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16c000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791700.298892:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ca2a1b4/0xcd6380150a323fb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298900:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ca2a1b4/0xcd6380150a323fb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298911:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ca2a1b4/0xcd6380150a323fb2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298917:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ca2a1b4/0xcd6380150a323fb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.298930:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791700.298932:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791700.298933:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788791700.299698:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788791700.308445:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791700.308458:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a323fb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.308475:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1788791700.308480:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791700.308487:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a323fb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.308503:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a323fb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.308514:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a323fb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.308522:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a323fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.308854:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788791700.309526:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788791700.309533:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a323fc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.309545:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1788791700.309549:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791700.309561:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a323fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.309572:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a323fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.309581:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a323fc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.309587:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a323fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.311216:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788791700.311230:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a323fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.311243:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851cb200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791700.311248:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a323fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.311259:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a323fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.311297:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a323fb9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.311305:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d39db273/0xcd6380150a323fb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.311344:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791700.311349:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a323fc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.311356:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851ca000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791700.311360:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a323fc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.311367:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a323fc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.311379:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a323fc0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.311386:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791700.311388:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791700.311390:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791700.315842:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788791700.315858:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a46dd328/0xcd6380150a323fc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.315898:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.320343:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.320356:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb26fe62/0xcd6380150a323fc7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.320375:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.320379:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.320386:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb26fe62/0xcd6380150a323fc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.320401:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb26fe62/0xcd6380150a323fc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.322789:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb26fe62/0xcd6380150a323fc7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.322798:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb26fe62/0xcd6380150a323fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.322824:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791700.323567:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791700.323577:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb26fe62/0xcd6380150a323fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.323597:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00e00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791700.323602:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb26fe62/0xcd6380150a323fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.323611:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb26fe62/0xcd6380150a323fc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.323631:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb26fe62/0xcd6380150a323fc7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.323637:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb26fe62/0xcd6380150a323fc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.323726:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791700.323728:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791700.323730:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.325775:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.325792:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a323fce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.325810:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.325815:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.325823:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a323fce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.325840:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a323fce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.325851:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a323fce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.325859:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a323fce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.325897:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791700.326765:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791700.326773:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a323fce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.326784:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00c00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791700.326789:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a323fce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.326799:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a323fce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.326830:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a323fce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.326838:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e71f114a/0xcd6380150a323fce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.326856:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791700.326858:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791700.326860:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.328352:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.328367:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d7713ac/0xcd6380150a323fd5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.328384:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.328389:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.330526:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d7713ac/0xcd6380150a323fd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.330557:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d7713ac/0xcd6380150a323fd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.330568:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d7713ac/0xcd6380150a323fd5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.330576:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d7713ac/0xcd6380150a323fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.330593:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791700.330865:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791700.330873:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d7713ac/0xcd6380150a323fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.330882:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01a00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791700.330887:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d7713ac/0xcd6380150a323fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.330896:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d7713ac/0xcd6380150a323fd5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.330926:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d7713ac/0xcd6380150a323fd5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.330932:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d7713ac/0xcd6380150a323fd5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.330950:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.330952:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.330954:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.331247:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.331254:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cf087e7/0xcd6380150a323fdc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.331265:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.331275:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.331281:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cf087e7/0xcd6380150a323fdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.331290:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cf087e7/0xcd6380150a323fdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.331298:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cf087e7/0xcd6380150a323fdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.331305:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cf087e7/0xcd6380150a323fdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.331324:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791700.332727:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791700.332738:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cf087e7/0xcd6380150a323fdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.332749:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01c00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791700.332754:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cf087e7/0xcd6380150a323fdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.332763:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cf087e7/0xcd6380150a323fdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.332779:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cf087e7/0xcd6380150a323fdc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.332787:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cf087e7/0xcd6380150a323fdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.332817:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791700.332819:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791700.332821:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.334009:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.334019:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b01eec64/0xcd6380150a323fe3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.334032:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.334036:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.334042:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b01eec64/0xcd6380150a323fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.334053:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b01eec64/0xcd6380150a323fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.334062:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b01eec64/0xcd6380150a323fe3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.334075:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b01eec64/0xcd6380150a323fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.334107:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791700.334205:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791700.334212:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b01eec64/0xcd6380150a323fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.334220:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01200 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791700.334224:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b01eec64/0xcd6380150a323fe3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.334233:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b01eec64/0xcd6380150a323fe3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.334247:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b01eec64/0xcd6380150a323fe3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.334254:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b01eec64/0xcd6380150a323fe3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.335054:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.335056:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.335058:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788791700.337383:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788791700.337976:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.337987:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a57b165b/0xcd6380150a323fea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.338004:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.338009:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.338015:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a57b165b/0xcd6380150a323fea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.338029:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a57b165b/0xcd6380150a323fea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.338039:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a57b165b/0xcd6380150a323fea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.338047:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a57b165b/0xcd6380150a323fea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.338070:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788791700.338506:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791700.338513:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a57b165b/0xcd6380150a323fea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.338523:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:0.0:1788791700.338527:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a57b165b/0xcd6380150a323fea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.338536:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a57b165b/0xcd6380150a323fea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.338554:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a57b165b/0xcd6380150a323fea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.338562:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a57b165b/0xcd6380150a323fea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.338580:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791700.338582:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791700.338584:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.339777:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.339788:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000918878b9/0xcd6380150a323ff1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.339809:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.339813:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.339820:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000918878b9/0xcd6380150a323ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.339832:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000918878b9/0xcd6380150a323ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.339841:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000918878b9/0xcd6380150a323ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.339848:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000918878b9/0xcd6380150a323ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.339871:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791700.340122:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791700.340143:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000918878b9/0xcd6380150a323ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.340151:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791700.340155:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000918878b9/0xcd6380150a323ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.340163:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000918878b9/0xcd6380150a323ff1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.340177:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000918878b9/0xcd6380150a323ff1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.340185:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000918878b9/0xcd6380150a323ff1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.340201:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.340203:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.340204:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.348342:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.348358:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000996fa990/0xcd6380150a323ff8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.348376:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.348380:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.348386:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000996fa990/0xcd6380150a323ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.348400:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000996fa990/0xcd6380150a323ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.348422:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000996fa990/0xcd6380150a323ff8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.348430:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000996fa990/0xcd6380150a323ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.348462:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791700.348536:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791700.348544:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000996fa990/0xcd6380150a323ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.348562:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01e00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791700.348567:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000996fa990/0xcd6380150a323ff8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.348577:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000996fa990/0xcd6380150a323ff8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.348595:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000996fa990/0xcd6380150a323ff8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.348601:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000996fa990/0xcd6380150a323ff8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.348619:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.348621:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.348623:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.348957:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.348963:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013651eef/0xcd6380150a323fff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.348972:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.348976:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.348980:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013651eef/0xcd6380150a323fff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.348989:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013651eef/0xcd6380150a323fff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.348997:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013651eef/0xcd6380150a323fff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.349003:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013651eef/0xcd6380150a323fff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.349037:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791700.349120:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791700.349144:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013651eef/0xcd6380150a323fff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.349152:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791700.349156:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013651eef/0xcd6380150a323fff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.349164:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013651eef/0xcd6380150a323fff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.349182:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013651eef/0xcd6380150a323fff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.349190:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013651eef/0xcd6380150a323fff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.349205:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.349206:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.349208:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.349465:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.349471:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006572f584/0xcd6380150a324006 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.349479:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.349483:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.349487:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006572f584/0xcd6380150a324006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.349496:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006572f584/0xcd6380150a324006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.349503:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006572f584/0xcd6380150a324006 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.349510:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006572f584/0xcd6380150a324006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.349532:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791700.349716:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791700.349721:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006572f584/0xcd6380150a324006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.349729:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791700.349732:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006572f584/0xcd6380150a324006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.349739:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006572f584/0xcd6380150a324006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.349749:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006572f584/0xcd6380150a324006 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.349756:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006572f584/0xcd6380150a324006 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.349779:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.349781:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.349784:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.349923:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.349929:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9a29e66/0xcd6380150a32400d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.349936:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.349945:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.349949:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9a29e66/0xcd6380150a32400d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.349959:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9a29e66/0xcd6380150a32400d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.349966:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9a29e66/0xcd6380150a32400d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.349972:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9a29e66/0xcd6380150a32400d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.349993:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791700.350066:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791700.350071:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9a29e66/0xcd6380150a32400d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.350078:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791700.350082:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9a29e66/0xcd6380150a32400d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.350160:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9a29e66/0xcd6380150a32400d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.350173:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9a29e66/0xcd6380150a32400d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.350179:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9a29e66/0xcd6380150a32400d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.350193:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.350195:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.350196:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.356772:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.356785:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009304331c/0xcd6380150a324014 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.356802:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.356807:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.356814:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009304331c/0xcd6380150a324014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.356828:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009304331c/0xcd6380150a324014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.356838:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009304331c/0xcd6380150a324014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.356852:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009304331c/0xcd6380150a324014 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.356880:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791700.356956:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791700.356964:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009304331c/0xcd6380150a324014 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.356982:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c00a00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791700.356987:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009304331c/0xcd6380150a324014 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.356996:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009304331c/0xcd6380150a324014 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.357014:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009304331c/0xcd6380150a324014 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.357021:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009304331c/0xcd6380150a324014 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.357042:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.357044:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.357046:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.357311:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.357317:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4911847/0xcd6380150a32401b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.357326:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.357329:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.357334:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4911847/0xcd6380150a32401b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.357343:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4911847/0xcd6380150a32401b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.357350:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4911847/0xcd6380150a32401b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.357357:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4911847/0xcd6380150a32401b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.357378:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791700.357395:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791700.357401:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4911847/0xcd6380150a32401b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.357409:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9abab2c01400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791700.357412:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4911847/0xcd6380150a32401b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.357420:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4911847/0xcd6380150a32401b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.357437:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4911847/0xcd6380150a32401b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.357444:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4911847/0xcd6380150a32401b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.357457:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.357459:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.357461:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.357757:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.357763:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfb4736e/0xcd6380150a324022 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.357776:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.357779:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.357783:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfb4736e/0xcd6380150a324022 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.357792:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfb4736e/0xcd6380150a324022 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.357800:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfb4736e/0xcd6380150a324022 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.357808:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfb4736e/0xcd6380150a324022 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.357827:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791700.357949:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791700.357955:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfb4736e/0xcd6380150a324022 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.357963:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81524c00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791700.357966:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfb4736e/0xcd6380150a324022 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.357974:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfb4736e/0xcd6380150a324022 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.357986:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfb4736e/0xcd6380150a324022 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.357993:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfb4736e/0xcd6380150a324022 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.358019:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.358021:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.358023:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.358231:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.358237:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048e22e66/0xcd6380150a324029 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.358244:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.358247:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.358251:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048e22e66/0xcd6380150a324029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.358260:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048e22e66/0xcd6380150a324029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.358278:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048e22e66/0xcd6380150a324029 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.358285:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048e22e66/0xcd6380150a324029 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.358305:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791700.358336:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791700.358341:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048e22e66/0xcd6380150a324029 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.358349:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81524a00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791700.358352:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048e22e66/0xcd6380150a324029 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.358361:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048e22e66/0xcd6380150a324029 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.358372:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048e22e66/0xcd6380150a324029 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.358379:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048e22e66/0xcd6380150a324029 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.358392:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.358394:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.358396:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.358694:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.358700:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad9f596e/0xcd6380150a324030 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.358709:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.358712:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.358716:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad9f596e/0xcd6380150a324030 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.358725:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad9f596e/0xcd6380150a324030 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.358733:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad9f596e/0xcd6380150a324030 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.358740:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad9f596e/0xcd6380150a324030 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.358772:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791700.358944:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791700.358950:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad9f596e/0xcd6380150a324030 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.358968:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81525000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791700.358972:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad9f596e/0xcd6380150a324030 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.358979:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad9f596e/0xcd6380150a324030 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.358991:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad9f596e/0xcd6380150a324030 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.358998:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad9f596e/0xcd6380150a324030 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.359013:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.359014:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.359016:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.364513:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.364527:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a381e8/0xcd6380150a324037 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.364545:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.364550:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.364556:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a381e8/0xcd6380150a324037 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.364570:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7a381e8/0xcd6380150a324037 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.364581:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a381e8/0xcd6380150a324037 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.364589:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a381e8/0xcd6380150a324037 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.364618:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791700.364661:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791700.364671:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7a381e8/0xcd6380150a324037 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.364682:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81524e00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791700.364687:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a381e8/0xcd6380150a324037 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.364711:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a381e8/0xcd6380150a324037 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.364731:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7a381e8/0xcd6380150a324037 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.364739:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7a381e8/0xcd6380150a324037 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.364761:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791700.364763:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791700.364766:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.365071:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.365077:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3254aa1/0xcd6380150a32403e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.365098:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.365108:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.365113:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a3254aa1/0xcd6380150a32403e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.365122:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a3254aa1/0xcd6380150a32403e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.365160:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a3254aa1/0xcd6380150a32403e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.365166:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a3254aa1/0xcd6380150a32403e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.365189:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788791700.365225:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788791700.365231:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a3254aa1/0xcd6380150a32403e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.365240:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81525600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791700.365245:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3254aa1/0xcd6380150a32403e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.365263:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a3254aa1/0xcd6380150a32403e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.365275:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a3254aa1/0xcd6380150a32403e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.365296:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a3254aa1/0xcd6380150a32403e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791700.365314:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791700.365316:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788791700.365319:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788791700.367240:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.367251:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f057279/0xcd6380150a324045 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.367267:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.367271:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.367277:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f057279/0xcd6380150a324045 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.367290:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f057279/0xcd6380150a324045 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.367299:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f057279/0xcd6380150a324045 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.367312:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f057279/0xcd6380150a324045 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.367482:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788791700.367965:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.367972:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0e1ce4/0xcd6380150a32404c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.367983:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.367987:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.367991:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b0e1ce4/0xcd6380150a32404c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.368001:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b0e1ce4/0xcd6380150a32404c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.368010:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b0e1ce4/0xcd6380150a32404c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.368017:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b0e1ce4/0xcd6380150a32404c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.368028:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788791700.368048:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788791700.368773:0:15046:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788791700.368780:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d757210/0xcd6380150a324053 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.368795:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=476s v=(0 0) 00010000:00010000:1.0:1788791700.368798:0:15046:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791700.368804:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d757210/0xcd6380150a324053 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.368814:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d757210/0xcd6380150a324053 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.368822:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d757210/0xcd6380150a324053 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.368830:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d757210/0xcd6380150a324053 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791700.371588:0:14350:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788791700.371590:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f057279/0xcd6380150a324045 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.371609:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81524600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791700.371615:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f057279/0xcd6380150a324045 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.371626:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f057279/0xcd6380150a324045 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.371659:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f057279/0xcd6380150a324045 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.371667:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f057279/0xcd6380150a324045 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.371693:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791700.371698:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d757210/0xcd6380150a324053 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.371705:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81524000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791700.371709:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d757210/0xcd6380150a324053 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.371716:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d757210/0xcd6380150a324053 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.371726:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d757210/0xcd6380150a324053 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.371734:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.371736:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.371738:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.371814:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.371821:0:14350:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b0e1ce4/0xcd6380150a32404c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.371840:0:15046:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788791700.371841:0:14350:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81525c00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791700.371847:0:14350:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0e1ce4/0xcd6380150a32404c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791700.371851:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d757210/0xcd6380150a324053 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.371858:0:14350:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b0e1ce4/0xcd6380150a32404c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.371877:0:14350:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b0e1ce4/0xcd6380150a32404c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.371884:0:14350:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b0e1ce4/0xcd6380150a32404c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791700.371902:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.371905:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788791700.372274:0:15046:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1788791700.372514:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14386:x1875683630482560:12345-0@lo:5:osp-pre-1-0.0 Request processed in 104553us (104615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791700.372531:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788791700.372623:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791700.372819:0:14386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14386:1875683630482560:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788791700.372836:0:14386:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788791700.372891:0:14386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14386:1875683630482688:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788791700.372933:0:14386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791700.372984:0:14386:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba9921a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788791700.373159:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630482688 00000100:00100000:1.0:1788791700.373166:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630482688 00000100:00100000:1.0:1788791700.373210:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788791700.373220:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14386:x1875683630482688:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788791700.373271:0:15043:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1788791700.375451:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.375571:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791700.375575:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791700.381970:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14386:x1875683630482688:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8743us (9028us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788791700.381990:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788791700.381997:0:14386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14386:1875683630482688:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788791700.382018:0:14386:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1788791700.583655:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791701.604810:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788791702.064213:0:16118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg129-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788791702.629329:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791703.651914:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791704.533538:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791704.533972:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606371328 00000100:00100000:3.0:1788791704.533982:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606371328 00000100:00100000:3.0:1788791704.534036:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:3.0:1788791704.534045:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba99370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2351:x1875683606371328:12345-192.168.201.29@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788791704.534073:0:14354:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d5a45585-bfa2-4f9a-ac32-a3df3c538c81@192.168.201.29@tcp t0 exp 0000000000000000 cur 480 last 0 00000020:00000080:3.0:1788791704.534107:0:14354:0:(genops.c:1385:class_connect()) connect: client d5a45585-bfa2-4f9a-ac32-a3df3c538c81, cookie 0xcd6380150a32405a 00000100:00080000:3.0:1788791704.534285:0:14354:0:(import.c:65:import_set_state_nolock()) ffff9abaa9b3a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788791704.534347:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba99370050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+5:2351:x1875683606371328:12345-192.168.201.29@tcp:250:mount.lustre.0 Request processed in 301us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791704.534355:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 75 00000100:00100000:1.0:1788791704.542362:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791704.542474:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606371456 00000100:00100000:3.0:1788791704.542485:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606371456 00000100:00100000:3.0:1788791704.542548:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:3.0:1788791704.542559:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+5:13757:x1875683606371456:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788791704.542576:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791704.542595:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16c000/0xcd6380150a324061 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453675349 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791704.542622:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16c000/0xcd6380150a324061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675349 expref: 6 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791704.542633:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16c000/0xcd6380150a324061 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675349 expref: 6 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791704.542642:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c000, rc 0) 00000100:00100000:3.0:1788791704.542708:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+6:13757:x1875683606371456:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 151us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791704.542715:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 76 00000100:00100000:0.0:1788791704.563846:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791704.563926:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606371584 00000100:00100000:1.0:1788791704.563937:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606371584 00000100:00100000:1.0:1788791704.563991:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:1.0:1788791704.564001:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+6:13757:x1875683606371584:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788791704.564300:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+6:13757:x1875683606371584:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 300us (463us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788791704.564309:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 77 00000100:00100000:2.0:1788791704.570570:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791704.571020:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606371712 00000100:00100000:0.0:1788791704.571032:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606371712 00000100:00100000:0.0:1788791704.571092:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:0.0:1788791704.571102:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+6:13757:x1875683606371712:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788791704.571119:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791704.571177:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba851cb000/0xcd6380150a324068 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453675350 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791704.571204:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba851cb000/0xcd6380150a324068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675350 expref: 7 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791704.571215:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba851cb000/0xcd6380150a324068 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675350 expref: 7 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791704.571225:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba851cb000, rc 0) 00000100:00100000:0.0:1788791704.571287:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+7:13757:x1875683606371712:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 186us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791704.571294:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 78 00000100:00100000:0.0:1788791704.574279:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791704.574366:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606371840 00000100:00100000:3.0:1788791704.574376:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606371840 00000100:00100000:3.0:1788791704.574427:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:3.0:1788791704.574437:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+7:13757:x1875683606371840:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788791704.574745:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+8:13757:x1875683606371840:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 309us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791704.574753:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 79 00000100:00100000:3.0:1788791704.581627:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791704.581732:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606371968 00000100:00100000:1.0:1788791704.581743:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606371968 00000100:00100000:1.0:1788791704.581797:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:1.0:1788791704.581806:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+8:13757:x1875683606371968:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788791704.582047:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+8:13757:x1875683606371968:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 240us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791704.582055:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 80 00000100:00100000:2.0:1788791704.585328:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791704.585531:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606372096 00000100:00100000:0.0:1788791704.585553:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606372096 00000100:00100000:0.0:1788791704.585630:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:0.0:1788791704.585639:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+8:13775:x1875683606372096:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788791704.585907:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+8:13775:x1875683606372096:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 267us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791704.585915:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 81 00000100:00100000:0.0:1788791704.606179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791704.606399:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606372224 00000100:00100000:3.0:1788791704.606417:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606372224 00000100:00100000:3.0:1788791704.606473:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:3.0:1788791704.606484:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+8:13775:x1875683606372224:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788791704.606765:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+8:13775:x1875683606372224:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 281us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791704.606774:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 82 00000100:00100000:3.0:1788791704.630382:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791704.632957:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606372352 00000100:00100000:1.0:1788791704.632975:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606372352 00000100:00100000:1.0:1788791704.633061:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:1.0:1788791704.633071:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+8:13757:x1875683606372352:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788791704.633087:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791704.633105:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba81524600/0xcd6380150a32406f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a945367537a expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791704.633173:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba81524600/0xcd6380150a32406f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367537a expref: 9 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791704.633203:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba81524600/0xcd6380150a32406f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367537a expref: 9 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791704.633212:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba81524600, rc 0) 00000100:00100000:1.0:1788791704.633270:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+9:13757:x1875683606372352:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 201us (2900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791704.633277:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 83 00000100:00100000:2.0:1788791704.639253:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791704.639350:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606372480 00000100:00100000:0.0:1788791704.639360:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606372480 00000100:00100000:0.0:1788791704.639408:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:0.0:1788791704.639417:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+9:13757:x1875683606372480:12345-192.168.201.29@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788791704.639440:0:14354:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788791704.639465:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788791704.639469:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788791704.639472:0:14354:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788791704.639474:0:14354:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1788791704.642422:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+9:13757:x1875683606372480:12345-192.168.201.29@tcp:256:mount.lustre.0 Request processed in 2997us (3170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791704.642436:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 84 00000100:00100000:1.0:1788791704.646650:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791704.646771:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606372608 00000100:00100000:0.0:1788791704.646782:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606372608 00000100:00100000:0.0:1788791704.646871:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:0.0:1788791704.646891:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+9:13757:x1875683606372608:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788791704.646907:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791704.646926:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba851ca800/0xcd6380150a324076 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453675381 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791704.646951:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba851ca800/0xcd6380150a324076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675381 expref: 10 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791704.646961:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba851ca800/0xcd6380150a324076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675381 expref: 10 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791704.646982:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba851ca800, rc 0) 00000100:00100000:0.0:1788791704.647048:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+10:13757:x1875683606372608:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 160us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791704.647055:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 85 00000100:00100000:2.0:1788791704.649086:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791704.651259:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606372736 00000100:00100000:3.0:1788791704.651273:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606372736 00000100:00100000:3.0:1788791704.651342:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:3.0:1788791704.651351:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+10:13757:x1875683606372736:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788791704.651842:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+10:13757:x1875683606372736:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 490us (2762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791704.651850:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 86 00000100:00100000:1.0:1788791704.654336:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791704.654537:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606372864 00000100:00100000:0.0:1788791704.654547:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606372864 00000100:00100000:0.0:1788791704.654649:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:0.0:1788791704.654660:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+10:13757:x1875683606372864:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788791704.654946:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+10:13757:x1875683606372864:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 286us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791704.654954:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 87 00000100:00100000:1.0:1788791704.658432:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791704.658714:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606372992 00000100:00100000:0.0:1788791704.658723:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606372992 00000100:00100000:0.0:1788791704.658771:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00100000:0.0:1788791704.658781:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+10:13781:x1875683606372992:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788791704.659693:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+10:13781:x1875683606372992:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 909us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791704.659704:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 88 00000100:00100000:2.0:1788791704.665852:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791704.665952:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606373120 00000100:00100000:0.0:1788791704.665963:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606373120 00000100:00100000:0.0:1788791704.666031:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 89 00000100:00100000:0.0:1788791704.666041:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+10:13781:x1875683606373120:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788791704.666357:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+10:13781:x1875683606373120:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 316us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791704.666373:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 89 00010000:00010000:3.0:1788791704.675825:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791704.693652:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791704.695501:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606373248 00000100:00100000:0.0:1788791704.695517:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606373248 00000100:00100000:0.0:1788791704.695579:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:0.0:1788791704.695597:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2351:x1875683606373248:12345-192.168.201.29@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788791704.695628:0:14362:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6788f146-04ff-4ba5-8299-9481a02c8bed@192.168.201.29@tcp t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:0.0:1788791704.695681:0:14362:0:(genops.c:1385:class_connect()) connect: client 6788f146-04ff-4ba5-8299-9481a02c8bed, cookie 0xcd6380150a32407d 00000004:00100000:0.0:1788791704.695711:0:14362:0:(mdt_handler.c:7331:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788791704.695717:0:14362:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788791704.720000:0:14362:0:(import.c:65:import_set_state_nolock()) ffff9ab9836a4800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788791704.720101:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+6:2351:x1875683606373248:12345-192.168.201.29@tcp:38:mount.lustre.0 Request processed in 24502us (26457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791704.720114:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:1.0:1788791704.723712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791704.723794:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791704.723881:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606373504 00000100:00100000:3.0:1788791704.723894:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606373504 00000100:00100000:3.0:1788791704.723978:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606373376 00000100:00100000:3.0:1788791704.723982:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606373376 00000100:00100000:3.0:1788791704.723998:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788791704.724019:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+7:13757:x1875683606373504:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788791704.724066:0:14361:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788791704.724184:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+7:13757:x1875683606373504:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 177us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791704.724203:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788791704.724221:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1788791704.724227:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+6:0:x1875683606373376:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788791704.724238:0:14361:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788791704.724259:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+6:0:x1875683606373376:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 32us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791704.724265:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00080000:1.0:1788791704.724328:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791704.726888:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791704.727077:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606373632 00000100:00100000:3.0:1788791704.727087:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606373632 00000100:00100000:3.0:1788791704.727211:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1788791704.727222:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+6:13757:x1875683606373632:12345-192.168.201.29@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788791704.727315:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+6:13757:x1875683606373632:12345-192.168.201.29@tcp:40:mount.lustre.0 Request processed in 95us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791704.727332:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1788791704.729182:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791704.729342:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606374016 00000100:00100000:2.0:1788791704.729352:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606374016 00000100:00100000:2.0:1788791704.729402:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1788791704.729413:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+6:13757:x1875683606374016:12345-192.168.201.29@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788791704.733323:0:14364:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3832us 00000100:00100000:3.0:1788791704.734164:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791704.734196:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791704.734227:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606373760 00000100:00100000:3.0:1788791704.734236:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606373760 00000100:00100000:3.0:1788791704.734275:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606373888 00000100:00100000:3.0:1788791704.734278:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606373888 00000100:00100000:3.0:1788791704.734293:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1788791704.734302:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1875683606373760:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788791704.734338:0:15045:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6788f146-04ff-4ba5-8299-9481a02c8bed@192.168.201.29@tcp t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:3.0:1788791704.734387:0:15045:0:(genops.c:1385:class_connect()) connect: client 6788f146-04ff-4ba5-8299-9481a02c8bed, cookie 0xcd6380150a324084 00002000:00100000:3.0:1788791704.734399:0:15045:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6788f146-04ff-4ba5-8299-9481a02c8bed/ffff9abaa9b38800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788791704.734423:0:15045:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788791704.734766:0:15045:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788791704.734794:0:15045:0:(import.c:65:import_set_state_nolock()) ffff9abaa9b3d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788791704.734858:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+6:2351:x1875683606373760:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 555us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791704.734867:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1788791704.734885:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:3.0:1788791704.734890:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1875683606373888:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788791704.734906:0:15045:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6788f146-04ff-4ba5-8299-9481a02c8bed@192.168.201.29@tcp t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:3.0:1788791704.734921:0:15045:0:(genops.c:1385:class_connect()) connect: client 6788f146-04ff-4ba5-8299-9481a02c8bed, cookie 0xcd6380150a32408b 00002000:00100000:3.0:1788791704.734926:0:15045:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6788f146-04ff-4ba5-8299-9481a02c8bed/ffff9abaa9b3d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788791704.734941:0:15045:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788791704.735069:0:15045:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788791704.735083:0:15045:0:(import.c:65:import_set_state_nolock()) ffff9abaa9b3e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788791704.735109:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+6:2351:x1875683606373888:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 217us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791704.735115:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000004:00200000:3.0:1788791704.752781:0:14364:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1788791704.753035:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+6:13757:x1875683606374016:12345-192.168.201.29@tcp:33:mount.lustre.0 Request processed in 23617us (23854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791704.753052:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1788791704.869635:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630482816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788791704.869722:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791704.872328:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630482816 00000100:00100000:0.0:1788791704.872345:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630482816 00000100:00100000:0.0:1788791704.872422:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788791704.872433:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630482816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788791704.872477:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788791704.872497:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788791704.872573:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630482816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (2851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791704.872590:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788791704.872644:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb82c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630482816:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788791704.920266:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6788f146-04ff-4ba5-8299-9481a02c8bed 00000100:00100000:3.0:1788791704.961828:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791704.962014:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606374144 00000100:00100000:0.0:1788791704.962025:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606374144 00000100:00100000:0.0:1788791704.962095:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:0.0:1788791704.962106:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+6:13803:x1875683606374144:12345-192.168.201.29@tcp:101:mkdir.0 00010000:00010000:0.0:1788791704.962163:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791704.962190:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba851ca400/0xcd6380150a324092 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536753ab expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791704.962261:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba851cb800/0xcd6380150a324099 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791704.962288:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba851cb800/0xcd6380150a324099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791704.962304:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba851cb800/0xcd6380150a324099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788791704.962544:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1788791704.962549:0:14362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1788791704.963227:0:14362:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba851cb800/0xcd6380150a324099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791704.963265:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba851ca400/0xcd6380150a324092 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536753ab expref: 8 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791704.963288:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba851cb800/0xcd6380150a324099 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536753ab expref: 7 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791704.963298:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613000) 00010000:00010000:3.0:1788791704.963302:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788791704.963306:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba851cb800, rc 0) 00000100:00100000:3.0:1788791704.963393:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+7:13803:x1875683606374144:12345-192.168.201.29@tcp:101:mkdir.0 Request processed in 1288us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791704.963401:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1788791705.379342:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa113159-ee5b-4f24-93ba-c8c094c83d87:3314:1875683630482944:0@lo:400:kworker.0 00000100:00100000:2.0:1788791705.379413:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791705.379428:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630483072:0@lo:400:kworker.0 00000100:00100000:2.0:1788791705.379470:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630483456:0@lo:400:kworker.0 00000100:00100000:3.0:1788791705.379639:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630483200:0@lo:400:kworker.0 00000100:00100000:1.0:1788791705.380169:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630482944 00000100:00100000:1.0:1788791705.380178:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630482944 00000100:00100000:1.0:1788791705.380224:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788791705.380233:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3314:x1875683630482944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791705.380542:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791705.380667:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791705.380677:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630483584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791705.380722:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791705.380752:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630483584 00000100:00100000:2.0:1788791705.380756:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630483584 00000100:00100000:2.0:1788791705.380787:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788791705.380794:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875683630483584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788791705.380809:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791705.380839:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875683630483584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791705.380846:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788791705.380865:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788791705.380968:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630483584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791705.381023:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630483328:0@lo:400:kworker.0 00000100:00100000:2.0:1788791705.381046:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791705.381081:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630483456 00000100:00100000:2.0:1788791705.381085:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630483456 00000100:00100000:2.0:1788791705.381119:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630483328 00000100:00100000:2.0:1788791705.381141:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630483328 00000100:00100000:2.0:1788791705.381158:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788791705.381163:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630483456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791705.381195:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630483456:12345-0@lo:400:kworker.0 Request processed in 32us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791705.381201:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788791705.381211:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788791705.381216:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630483328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791705.381240:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875683630483328:12345-0@lo:400:kworker.0 Request processed in 23us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791705.381245:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788791705.381255:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791705.381270:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875683630483328:0@lo:400:kworker.0 00000100:00100000:2.0:1788791705.381293:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb041880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630483456:0@lo:400:kworker.0 00000100:00100000:0.0:1788791705.390492:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791705.391535:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630483072 00000100:00100000:2.0:1788791705.391546:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630483072 00000100:00100000:2.0:1788791705.391978:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788791705.391989:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1875683630483072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791705.392090:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3315:x1875683630483072:12345-0@lo:400:kworker.0 Request processed in 102us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791705.392097:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788791705.392846:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630483072:0@lo:400:kworker.0 00000100:00100000:3.0:1788791705.393484:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791705.393704:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630483200 00000100:00100000:2.0:1788791705.393712:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630483200 00000100:00100000:2.0:1788791705.393755:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788791705.393763:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630483200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791705.393822:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630483200:12345-0@lo:400:kworker.0 Request processed in 59us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791705.393841:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788791705.394536:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbca1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3314:x1875683630482944:12345-0@lo:400:kworker.0 Request processed in 14301us (15120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791705.394546:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788791705.394583:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:aa113159-ee5b-4f24-93ba-c8c094c83d87:3314:1875683630482944:0@lo:400:kworker.0 00000100:00100000:0.0:1788791705.399421:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630483200:0@lo:400:kworker.0 00000001:00080000:1.0:1788791705.525569:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788791705.525618:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6788f146-04ff-4ba5-8299-9481a02c8bed 00000001:00100000:1.0:1788791705.525631:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788791705.699369:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788791706.211866:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788791706.723562:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791707.151272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791707.151437:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606374272 00000100:00100000:2.0:1788791707.151448:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606374272 00000100:00100000:2.0:1788791707.151549:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:2.0:1788791707.151560:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+7:13855:x1875683606374272:12345-192.168.201.29@tcp:41:lfs.0 00000004:00000024:2.0:1788791707.151612:0:14362:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788791707.151712:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+7:13855:x1875683606374272:12345-192.168.201.29@tcp:41:lfs.0 Request processed in 154us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791707.151719:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00080000:3.0:1788791707.151837:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791707.155945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791707.156525:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606374400 00000100:00100000:2.0:1788791707.156537:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606374400 00000100:00100000:2.0:1788791707.156632:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:2.0:1788791707.156643:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6788f146-04ff-4ba5-8299-9481a02c8bed+5:13855:x1875683606374400:12345-192.168.201.29@tcp:13:lfs.0 00002000:00000024:2.0:1788791707.156680:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791707.156768:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6788f146-04ff-4ba5-8299-9481a02c8bed+5:13855:x1875683606374400:12345-192.168.201.29@tcp:13:lfs.0 Request processed in 126us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791707.156776:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00080000:3.0:1788791707.157358:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788791707.167053:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791707.167262:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606374528 00000100:00100000:2.0:1788791707.167294:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606374528 00000100:00100000:2.0:1788791707.167371:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:2.0:1788791707.167382:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6788f146-04ff-4ba5-8299-9481a02c8bed+5:13855:x1875683606374528:12345-192.168.201.29@tcp:13:lfs.0 00002000:00000024:2.0:1788791707.167421:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791707.167509:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6788f146-04ff-4ba5-8299-9481a02c8bed+5:13855:x1875683606374528:12345-192.168.201.29@tcp:13:lfs.0 Request processed in 128us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791707.167534:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00080000:3.0:1788791707.168115:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788791707.432206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791707.433027:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606374656 00000100:00100000:3.0:1788791707.433038:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606374656 00000100:00100000:3.0:1788791707.433103:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:3.0:1788791707.433113:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+10:13889:x1875683606374656:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788791707.433152:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791707.433185:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16d000/0xcd6380150a3240a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a94536753b2 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791707.433214:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16d000/0xcd6380150a3240a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536753b2 expref: 11 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791707.433226:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16d000/0xcd6380150a3240a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536753b2 expref: 11 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791707.433235:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d000, rc 0) 00000100:00100000:3.0:1788791707.433314:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+11:13889:x1875683606374656:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 202us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791707.433321:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 91 00000100:00100000:1.0:1788791707.437771:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791707.437884:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606374784 00000100:00100000:0.0:1788791707.437894:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606374784 00000100:00100000:0.0:1788791707.437952:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:0.0:1788791707.437971:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+11:13889:x1875683606374784:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788791707.438383:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+11:13889:x1875683606374784:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 421us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791707.438392:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 92 00000100:00100000:1.0:1788791707.447169:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791707.447290:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606374912 00000100:00100000:0.0:1788791707.447310:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606374912 00000100:00100000:0.0:1788791707.447373:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 93 00000100:00100000:0.0:1788791707.447384:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+11:13889:x1875683606374912:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788791707.448461:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+11:13889:x1875683606374912:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 1073us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791707.448473:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 93 00000100:00100000:1.0:1788791707.454659:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791707.454744:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606375040 00000100:00100000:3.0:1788791707.454755:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606375040 00000100:00100000:3.0:1788791707.454809:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:3.0:1788791707.454820:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+11:13894:x1875683606375040:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788791707.455717:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+11:13894:x1875683606375040:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 895us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791707.455727:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 94 00000100:00100000:1.0:1788791707.491702:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791707.494872:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606375168 00000100:00100000:0.0:1788791707.494890:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606375168 00000100:00100000:0.0:1788791707.494970:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00100000:0.0:1788791707.494981:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+11:13894:x1875683606375168:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788791707.495310:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+11:13894:x1875683606375168:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 330us (3617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791707.495318:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 95 00000100:00100000:0.0:1788791707.503798:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791707.507825:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606375296 00000100:00100000:3.0:1788791707.507841:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606375296 00000100:00100000:2.0:1788791707.511653:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:2.0:1788791707.511679:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+11:13889:x1875683606375296:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788791707.511697:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791707.511718:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb81be00/0xcd6380150a3240a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a94536753dc expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791707.511748:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb81be00/0xcd6380150a3240a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536753dc expref: 12 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791707.511759:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb81be00/0xcd6380150a3240a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536753dc expref: 12 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791707.511769:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81be00, rc 0) 00000100:00100000:2.0:1788791707.511846:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+12:13889:x1875683606375296:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 171us (8058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791707.511854:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 96 00000100:00100000:1.0:1788791707.515017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791707.515773:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606375424 00000100:00100000:2.0:1788791707.515785:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606375424 00000100:00100000:2.0:1788791707.515846:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00100000:2.0:1788791707.515857:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+12:13889:x1875683606375424:12345-192.168.201.29@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788791707.515882:0:14356:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788791707.515905:0:14356:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788791707.515909:0:14356:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788791707.515912:0:14356:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788791707.515915:0:14356:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788791707.518934:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+12:13889:x1875683606375424:12345-192.168.201.29@tcp:256:mount.lustre.0 Request processed in 2807us (3653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791707.518948:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 97 00000100:00100000:1.0:1788791707.521616:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791707.521818:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606375552 00000100:00100000:3.0:1788791707.521828:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606375552 00000100:00100000:3.0:1788791707.521882:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 98 00000100:00100000:3.0:1788791707.521892:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+12:13889:x1875683606375552:12345-192.168.201.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788791707.521906:0:14355:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791707.521924:0:14355:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb16c400/0xcd6380150a3240ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a94536753e3 expref: -99 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791707.521973:0:14355:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb16c400/0xcd6380150a3240ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536753e3 expref: 13 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791707.521985:0:14355:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb16c400/0xcd6380150a3240ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536753e3 expref: 13 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791707.521996:0:14355:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16c400, rc 0) 00000100:00100000:3.0:1788791707.522059:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:13889:x1875683606375552:12345-192.168.201.29@tcp:101:mount.lustre.0 Request processed in 168us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791707.522066:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 98 00000100:00100000:1.0:1788791707.527719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791707.527876:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606375680 00000100:00100000:2.0:1788791707.527887:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606375680 00000100:00100000:2.0:1788791707.527947:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:2.0:1788791707.527967:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:13889:x1875683606375680:12345-192.168.201.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788791707.528297:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:13889:x1875683606375680:12345-192.168.201.29@tcp:501:mount.lustre.0 Request processed in 339us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791707.528502:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 99 00000100:00100000:1.0:1788791707.531111:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791707.531545:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606375808 00000100:00100000:2.0:1788791707.531555:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606375808 00000100:00100000:2.0:1788791707.533966:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00100000:2.0:1788791707.533997:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:13889:x1875683606375808:12345-192.168.201.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788791707.534435:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:13889:x1875683606375808:12345-192.168.201.29@tcp:503:mount.lustre.0 Request processed in 453us (3346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791707.534443:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 100 00000100:00100000:1.0:1788791707.542282:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791707.542412:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606375936 00000100:00100000:3.0:1788791707.542424:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606375936 00000100:00100000:3.0:1788791707.542474:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:3.0:1788791707.542482:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:13899:x1875683606375936:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788791707.542753:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:13899:x1875683606375936:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 271us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791707.542762:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 101 00000100:00100000:3.0:1788791707.552581:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791707.558485:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606376064 00000100:00100000:1.0:1788791707.558509:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606376064 00000100:00100000:1.0:1788791707.558582:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 102 00000100:00100000:1.0:1788791707.558591:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:13899:x1875683606376064:12345-192.168.201.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788791707.558864:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:13899:x1875683606376064:12345-192.168.201.29@tcp:502:llog_process_th.0 Request processed in 272us (6293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791707.558872:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 102 00000100:00100000:1.0:1788791707.564809:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791707.564845:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791707.564877:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791707.564909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791707.564938:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606376832 00000100:00100000:1.0:1788791707.564948:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606376832 00000100:00100000:0.0:1788791707.564995:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606376704 00000100:00100000:0.0:1788791707.564999:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606376704 00000100:00100000:1.0:1788791707.565009:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:1.0:1788791707.565018:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2352:x1875683606376832:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791707.565018:0:15046:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788791707.565025:0:15046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788791707.565098:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2352:x1875683606376832:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 80us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791707.565105:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:0.0:1788791707.565120:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606376192 00000100:00100000:1.0:1788791707.565121:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:0.0:1788791707.565123:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606376192 00000100:00100000:1.0:1788791707.565150:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2352:x1875683606376704:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791707.565162:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606376576 00000100:00100000:0.0:1788791707.565165:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606376576 00000100:00100000:1.0:1788791707.565174:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2352:x1875683606376704:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 48us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791707.565180:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:0.0:1788791707.565182:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:0.0:1788791707.565188:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+7:2352:x1875683606376576:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791707.565216:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+7:2352:x1875683606376576:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 29us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791707.565223:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:0.0:1788791707.565237:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:0.0:1788791707.565241:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1875683606376192:12345-192.168.201.29@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788791707.565287:0:14363:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ab8deec1-d492-4ec8-be91-5e484d9b7641@192.168.201.29@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:0.0:1788791707.566075:0:14363:0:(genops.c:1385:class_connect()) connect: client ab8deec1-d492-4ec8-be91-5e484d9b7641, cookie 0xcd6380150a3240b5 00000004:00100000:0.0:1788791707.566106:0:14363:0:(mdt_handler.c:7331:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788791707.566259:0:14363:0:(import.c:65:import_set_state_nolock()) ffff9abab29d8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788791707.567948:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2351:x1875683606376192:12345-192.168.201.29@tcp:38:mount.lustre.0 Request processed in 2696us (3141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791707.567971:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:0.0:1788791707.586994:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791707.587098:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791707.587183:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606376320 00000100:00100000:3.0:1788791707.587194:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606376320 00000100:00100000:3.0:1788791707.587263:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606376448 00000100:00100000:3.0:1788791707.587267:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606376448 00000100:00080000:0.0:1788791707.587280:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791707.598479:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:2.0:1788791707.598521:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+7:0:x1875683606376320:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788791707.598561:0:14362:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788791707.598652:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+7:0:x1875683606376320:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 159us (11668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791707.598661:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:2.0:1788791707.598690:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1788791707.598697:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb82c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:13889:x1875683606376448:12345-192.168.201.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788791707.598722:0:14362:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788791707.598746:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb82c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:13889:x1875683606376448:12345-192.168.201.29@tcp:41:mount.lustre.0 Request processed in 51us (11649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791707.598753:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1788791707.607814:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791707.607955:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606376960 00000100:00100000:3.0:1788791707.607974:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606376960 00000100:00100000:3.0:1788791707.608031:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:3.0:1788791707.608040:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:13889:x1875683606376960:12345-192.168.201.29@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788791707.608177:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:13889:x1875683606376960:12345-192.168.201.29@tcp:40:mount.lustre.0 Request processed in 137us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791707.608184:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1788791707.619733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791707.619774:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791707.619808:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791707.619893:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606377088 00000100:00100000:3.0:1788791707.619904:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606377088 00000100:00100000:3.0:1788791707.619945:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606377216 00000100:00100000:3.0:1788791707.619949:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606377216 00000100:00100000:3.0:1788791707.619975:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788791707.619984:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1875683606377088:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788791707.620015:0:15045:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ab8deec1-d492-4ec8-be91-5e484d9b7641@192.168.201.29@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:3.0:1788791707.620062:0:15045:0:(genops.c:1385:class_connect()) connect: client ab8deec1-d492-4ec8-be91-5e484d9b7641, cookie 0xcd6380150a3240bc 00002000:00100000:3.0:1788791707.620075:0:15045:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ab8deec1-d492-4ec8-be91-5e484d9b7641/ffff9ababab17000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788791707.620087:0:15045:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788791707.620365:0:15045:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788791707.620394:0:15045:0:(import.c:65:import_set_state_nolock()) ffff9ababab14800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788791707.620457:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2351:x1875683606377088:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 473us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791707.620465:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788791707.620483:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1788791707.620487:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1875683606377216:12345-192.168.201.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788791707.620503:0:15045:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ab8deec1-d492-4ec8-be91-5e484d9b7641@192.168.201.29@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:3.0:1788791707.620520:0:15045:0:(genops.c:1385:class_connect()) connect: client ab8deec1-d492-4ec8-be91-5e484d9b7641, cookie 0xcd6380150a3240c3 00002000:00100000:3.0:1788791707.620525:0:15045:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ab8deec1-d492-4ec8-be91-5e484d9b7641/ffff9ababab16800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113952 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788791707.620544:0:15045:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788791707.620703:0:15045:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788791707.620720:0:15045:0:(import.c:65:import_set_state_nolock()) ffff9abaa0628000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788791707.620746:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2351:x1875683606377216:12345-192.168.201.29@tcp:8:mount.lustre.0 Request processed in 257us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791707.620753:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:1.0:1788791707.621471:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606377344 00000100:00100000:1.0:1788791707.621479:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606377344 00000100:00100000:1.0:1788791707.621527:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:1.0:1788791707.621545:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:13889:x1875683606377344:12345-192.168.201.29@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788791707.621739:0:14365:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1788791707.621880:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:13889:x1875683606377344:12345-192.168.201.29@tcp:33:mount.lustre.0 Request processed in 344us (2157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791707.621887:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00010000:00010000:3.0:1788791707.747384:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791707.792430:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791707.792527:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606377472 00000100:00100000:1.0:1788791707.792538:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606377472 00000100:00100000:1.0:1788791707.792618:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:1.0:1788791707.792628:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:13920:x1875683606377472:12345-192.168.201.29@tcp:101:mkdir.0 00010000:00010000:1.0:1788791707.792650:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791707.792672:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525000/0xcd6380150a3240ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367540d expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791707.792749:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a3240d1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791707.792761:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a3240d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791707.792769:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a3240d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791707.792940:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788791707.792944:0:14363:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791707.793040:0:14363:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a3240d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791707.793070:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525000/0xcd6380150a3240ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367540d expref: 8 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791707.793091:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a3240d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367540d expref: 7 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791707.793099:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613000) 00010000:00010000:1.0:1788791707.793102:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788791707.793105:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba81524e00, rc 0) 00000100:00100000:2.0:1788791707.794357:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab8deec1-d492-4ec8-be91-5e484d9b7641+7:13920:x1875683606377472:12345-192.168.201.29@tcp:101:mkdir.0 Request processed in 1721us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791707.794368:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00010000:00010000:0.0:1788791708.782277:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791709.795521:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791709.987404:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630483712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791709.987499:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791709.987678:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630483712 00000100:00100000:0.0:1788791709.987687:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630483712 00000100:00100000:0.0:1788791709.987757:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788791709.987768:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630483712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788791709.987824:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788791709.987885:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630483712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791709.987892:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788791709.987950:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630483712:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788791709.990283:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788791710.043331:0:6705:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ab8deec1-d492-4ec8-be91-5e484d9b7641 00000001:00100000:2.0:1788791710.067200:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ab8deec1-d492-4ec8-be91-5e484d9b7641 00000001:00100000:2.0:1788791710.067220:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6788f146-04ff-4ba5-8299-9481a02c8bed 00000100:00100000:0.0:1788791710.506035:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788791710.506066:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630483840:0@lo:400:kworker.0 00000100:00100000:0.0:1788791710.506159:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791710.506234:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630483968:0@lo:400:kworker.0 00000100:00100000:0.0:1788791710.506262:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791710.506298:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630483968 00000100:00100000:0.0:1788791710.506305:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630483968 00000100:00100000:0.0:1788791710.506359:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788791710.506369:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630483968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791710.506417:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630483968:12345-0@lo:400:kworker.0 Request processed in 49us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791710.506424:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788791710.506445:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788791710.506471:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788791710.506490:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630483968:0@lo:400:kworker.0 00000100:00100000:0.0:1788791710.506540:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630484096:0@lo:400:kworker.0 00000100:00100000:0.0:1788791710.506567:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791710.506610:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630484224:0@lo:400:kworker.0 00000100:00100000:0.0:1788791710.506630:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791710.506654:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630484096 00000100:00100000:0.0:1788791710.506658:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630484096 00000100:00100000:0.0:1788791710.506679:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630484224 00000100:00100000:0.0:1788791710.506682:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630484224 00000100:00100000:0.0:1788791710.506700:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788791710.506706:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630484096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791710.506739:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875683630484096:12345-0@lo:400:kworker.0 Request processed in 33us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791710.506754:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788791710.506766:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788791710.506771:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630484224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791710.506799:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875683630484224:12345-0@lo:400:kworker.0 Request processed in 28us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791710.506804:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788791710.506818:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791710.506832:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875683630484096:0@lo:400:kworker.0 00000100:00100000:0.0:1788791710.506848:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875683630484224:0@lo:400:kworker.0 00000100:00100000:0.0:1788791710.506871:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788791710.506877:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630484352:0@lo:400:kworker.0 00000100:00100000:0.0:1788791710.506900:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791710.506932:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630484352 00000100:00100000:0.0:1788791710.506936:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630484352 00000100:00100000:0.0:1788791710.506958:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788791710.506963:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630484352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788791710.506990:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630484352:12345-0@lo:400:kworker.0 Request processed in 27us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791710.506996:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788791710.507008:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791710.507021:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630484352:0@lo:400:kworker.0 00000100:00100000:2.0:1788791710.507438:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630483840 00000100:00100000:2.0:1788791710.507444:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630483840 00000100:00100000:2.0:1788791710.507470:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788791710.507476:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3312:x1875683630483840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791710.507513:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3312:x1875683630483840:12345-0@lo:400:kworker.0 Request processed in 38us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791710.507519:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788791710.513089:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630483840:0@lo:400:kworker.0 00000100:00100000:1.0:1788791710.517234:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788791710.517258:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630484480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788791710.517330:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791710.523329:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630484480 00000100:00100000:3.0:1788791710.523344:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630484480 00000100:00100000:3.0:1788791710.523396:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788791710.523407:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630484480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788791710.523440:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791710.523544:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875683630484480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (6213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791710.523552:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788791710.530401:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875683630484480:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788791710.613695:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ab8deec1-d492-4ec8-be91-5e484d9b7641 00010000:00010000:3.0:1788791710.825339:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788791710.826829:0:16324:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788791711.852312:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791712.813512:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791712.813558:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791712.813594:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791712.813623:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791712.813649:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791712.813671:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791712.813698:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791712.813727:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606377600 00000100:00100000:1.0:1788791712.813738:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606377600 00000100:00100000:1.0:1788791712.813789:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 104 00000100:00100000:1.0:1788791712.813799:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:2354:x1875683606377600:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791712.813878:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:2354:x1875683606377600:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 69us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791712.813886:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 104 00000100:00100000:1.0:1788791712.813922:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606377984 00000100:00100000:1.0:1788791712.813926:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606377984 00000100:00100000:1.0:1788791712.813955:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606378240 00000100:00100000:1.0:1788791712.813958:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606378240 00000100:00100000:1.0:1788791712.813971:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606377856 00000100:00100000:1.0:1788791712.813988:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606377856 00000100:00100000:1.0:1788791712.814006:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606378368 00000100:00100000:1.0:1788791712.814009:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606378368 00000100:00100000:1.0:1788791712.814026:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:1.0:1788791712.814032:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2354:x1875683606377984:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791712.814065:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7987b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2354:x1875683606377984:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 32us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791712.814072:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:1.0:1788791712.814086:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:1.0:1788791712.814092:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+5:2354:x1875683606378240:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791712.814116:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+5:2354:x1875683606378240:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 24us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791712.814123:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:1.0:1788791712.814164:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1788791712.814171:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2354:x1875683606377856:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791712.814286:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7986a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2354:x1875683606377856:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 36us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791712.814294:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:1.0:1788791712.814309:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:1.0:1788791712.814316:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+5:2354:x1875683606378368:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791712.814342:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+5:2354:x1875683606378368:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 27us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791712.814349:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:1.0:1788791712.814369:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606377728 00000100:00100000:1.0:1788791712.814379:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606377728 00000100:00100000:1.0:1788791712.814409:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606378112 00000100:00100000:1.0:1788791712.814412:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606378112 00000100:00100000:1.0:1788791712.814428:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:1.0:1788791712.814434:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab2d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+6:2354:x1875683606377728:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791712.814464:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab2d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+6:2354:x1875683606377728:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 30us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791712.814470:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:1.0:1788791712.814482:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:1.0:1788791712.814489:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2354:x1875683606378112:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791712.814511:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2354:x1875683606378112:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 22us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791712.814517:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00080000:1.0:1788791712.814667:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788791712.814672:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788791712.814675:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788791712.869381:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791713.892580:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788791714.278041:0:16472:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3ab9a730 20000000:00000080:3.0:1788791714.278062:0:16472:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9ab981ebb800 uarg=0000000000000000 20000000:01000000:3.0:1788791714.278099:0:16472:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788791714.278104:0:16472:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788791714.278108:0:16472:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788791714.281632:0:16473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788791714.286556:0:16472:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788791714.302333:0:16472:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788791714.302907:0:16472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9ababb81a600/0xcd6380150a3240d8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.302929:0:16472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ababb81b600/0xcd6380150a323dcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323dc8 expref: 18 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.302936:0:16472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ababb16dc00/0xcd6380150a323e1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323e15 expref: 18 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.302959:0:16472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba851cbe00/0xcd6380150a323f57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a323f50 expref: 18 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.302967:0:16472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9aba851ca800/0xcd6380150a324076 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675381 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.302974:0:16472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9ababb16c400/0xcd6380150a3240ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536753e3 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.302981:0:16472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9ababb81a600/0xcd6380150a3240d8 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303032:0:16472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ababb16c400/0xcd6380150a3240ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536753e3 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303048:0:16472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ababb16c400/0xcd6380150a3240ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536753e3 expref: 12 pid: 14355 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791714.303064:0:16472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb042a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875683630484608:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791714.303206:0:16472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba851ca800/0xcd6380150a324076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675381 expref: 12 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303215:0:16472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9aba851ca800/0xcd6380150a324076 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675381 expref: 12 pid: 14355 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791714.303224:0:16472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb042300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875683630484736:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791714.303259:0:16472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9aba851cbe00/0xcd6380150a323f57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a323f50 expref: 18 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303279:0:16472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9aba851cbe00/0xcd6380150a323f57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a323f50 expref: 18 pid: 14356 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791714.303290:0:16472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb041f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875683630484864:0@lo:104: 00000100:00100000:2.0:1788791714.303335:0:16472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788791714.303378:0:16472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ababb16dc00/0xcd6380150a323e1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a323e15 expref: 18 pid: 14355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303386:0:16472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ababb16dc00/0xcd6380150a323e1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a323e15 expref: 18 pid: 14355 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791714.303393:0:16472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb040e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875683630484992:0@lo:104: 00000100:00100000:2.0:1788791714.303412:0:16472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791714.303442:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630484864 00000100:00100000:2.0:1788791714.303449:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630484864 00000100:00100000:2.0:1788791714.303485:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630484992 00000100:00100000:2.0:1788791714.303488:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630484992 00000100:00100000:2.0:1788791714.303515:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788791714.303524:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb040700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+4:16472:x1875683630484864:12345-0@lo:104: 00010000:00010000:2.0:1788791714.303535:0:14344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9ababb81ae00/0xcd6380150a323f50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a323f57 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303579:0:14344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788791714.303586:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb040700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+4:16472:x1875683630484864:12345-0@lo:104: Request processed in 63us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791714.303592:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788791714.303608:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788791714.303614:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+3:16472:x1875683630484992:12345-0@lo:104: 00010000:00010000:2.0:1788791714.303628:0:14344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9ababb16ca00/0xcd6380150a323e15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a323e1c expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303663:0:14344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788791714.303669:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+3:16472:x1875683630484992:12345-0@lo:104: Request processed in 56us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791714.303675:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788791714.303693:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788791714.303699:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9ababb81ae00/0xcd6380150a323f50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a323f57 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303706:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81ae00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791714.303711:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9ababb81ae00/0xcd6380150a323f50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a323f57 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303719:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9ababb81ae00/0xcd6380150a323f50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a323f57 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791714.303726:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9ababb81ae00/0xcd6380150a323f50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a323f57 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791714.303732:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788791714.303758:0:14349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9ababb81ae00/0xcd6380150a323f50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323f57 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303766:0:14349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791714.303783:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9ababb81ae00/0xcd6380150a323f50 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323f57 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303790:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9ababb81ae00/0xcd6380150a323f50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323f57 expref: -99 pid: 15759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303808:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791714.303811:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9ababb16ca00/0xcd6380150a323e15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a323e1c expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303817:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16ca00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:2.0:1788791714.303819:0:14349:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16ca00/0xcd6380150a323e15 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a323e1c expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303849:0:14349:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9ababb16ca00/0xcd6380150a323e15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a323e1c expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788791714.303856:0:14349:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9ababb16ca00/0xcd6380150a323e15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a323e1c expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791714.303861:0:14349:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788791714.303877:0:14349:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9ababb16ca00/0xcd6380150a323e15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323e1c expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303883:0:14349:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788791714.303895:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9ababb16ca00/0xcd6380150a323e15 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323e1c expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303901:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9ababb16ca00/0xcd6380150a323e15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323e1c expref: -99 pid: 15042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303910:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791714.303911:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791714.303913:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791714.303917:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa113159-ee5b-4f24-93ba-c8c094c83d87:3315:1875683630485120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791714.303919:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788791714.303933:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa113159-ee5b-4f24-93ba-c8c094c83d87:3313:1875683630485248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788791714.303947:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788791714.303972:0:16472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9ababb81b600/0xcd6380150a323dcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd6380150a323dc8 expref: 18 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.303981:0:16472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9ababb81b600/0xcd6380150a323dcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd6380150a323dc8 expref: 18 pid: 14356 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791714.303984:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630485120 00000100:00100000:1.0:1788791714.303987:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630485120 00000100:00100000:2.0:1788791714.303989:0:16472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb487800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875683630485376:0@lo:104: 00010000:00010000:1.0:1788791714.304007:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba851cbe00/0xcd6380150a323f57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a323f50 expref: 19 pid: 14356 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791714.304013:0:16472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791714.304029:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788791714.304035:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3315:x1875683630485120:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791714.304037:0:14344:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1788791714.304045:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788791714.304046:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630485376 00000100:00100000:2.0:1788791714.304048:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630485376 00010000:00010000:1.0:1788791714.304055:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba851cbe00/0xcd6380150a323f57 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a323f50 expref: 19 pid: 14356 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791714.304064:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba851cbe00/0xcd6380150a323f57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a323f50 expref: 19 pid: 14356 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791714.304068:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788791714.304073:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba8325a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+3:16472:x1875683630485376:12345-0@lo:104: 00010000:00010000:1.0:1788791714.304079:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788791714.304080:0:14344:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a323dc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a323dcf expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791714.304104:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3315:x1875683630485120:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (156us total) trans 0 rc 0/0 00010000:00010000:2.0:1788791714.304105:0:14344:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788791714.304109:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba8325a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:aa113159-ee5b-4f24-93ba-c8c094c83d87+3:16472:x1875683630485376:12345-0@lo:104: Request processed in 36us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791714.304111:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788791714.304114:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788791714.304153:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791714.304172:0:16472:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba931d9480 going to sleep for 11 seconds 00000100:00100000:1.0:1788791714.304178:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630485248 00000100:00100000:1.0:1788791714.304181:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630485248 00010000:00010000:2.0:1788791714.304192:0:16472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba851cbe00/0xcd6380150a323f57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a323f50 expref: 19 pid: 14356 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791714.304193:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ababb16dc00/0xcd6380150a323e1c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a323e15 expref: 19 pid: 14355 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791714.304202:0:16472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb041f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875683630484864:0@lo:104: 00000100:00100000:1.0:1788791714.304210:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788791714.304211:0:16472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb040e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875683630484992:0@lo:104: 00000100:00100000:1.0:1788791714.304216:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7987800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:3313:x1875683630485248:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788791714.304217:0:16472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb487800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875683630485376:0@lo:104: 00010000:00010000:1.0:1788791714.304223:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791714.304227:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ababb16dc00/0xcd6380150a323e1c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a323e15 expref: 18 pid: 14355 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791714.304235:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ababb16dc00/0xcd6380150a323e1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a323e15 expref: 18 pid: 14355 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791714.304245:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16dc00/0xcd6380150a323e1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a323e15 expref: 18 pid: 14355 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791714.304253:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791714.304287:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7987800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:3313:x1875683630485248:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791714.304303:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788791714.304331:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb485500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa113159-ee5b-4f24-93ba-c8c094c83d87:3315:1875683630485120:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788791714.305155:0:16035:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788791714.305163:0:16035:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a323dc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd6380150a323dcf expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791714.305172:0:16035:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fea00 already unused, calling callback (ffffffffc1db1c20) 10000000:00010000:0.0:1788791714.305175:0:16035:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a323dc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd6380150a323dcf expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791714.305194:0:16035:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a323dc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd6380150a323dcf expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788791714.305201:0:16035:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a323dc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd6380150a323dcf expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788791714.305206:0:16035:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788791714.305230:0:16035:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a323dc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323dcf expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791714.305236:0:16035:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788791714.305245:0:16035:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a323dc8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323dcf expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791714.305251:0:16035:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.129@tcp lock: ffff9aba994fea00/0xcd6380150a323dc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd6380150a323dcf expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791714.305263:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791714.305265:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788791714.305267:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791714.305284:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788791714.305296:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630485504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788791714.305330:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788791714.305374:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791714.306020:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630485504 00000100:00100000:3.0:1788791714.306027:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630485504 00010000:00010000:3.0:1788791714.306051:0:14347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ababb81b600/0xcd6380150a323dcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a323dc8 expref: 17 pid: 14356 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791714.306167:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788791714.306197:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7a02850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:3312:x1875683630485504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788791714.306210:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791714.306215:0:14347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ababb81b600/0xcd6380150a323dcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd6380150a323dc8 expref: 17 pid: 14356 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791714.306224:0:14347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ababb81b600/0xcd6380150a323dcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd6380150a323dc8 expref: 17 pid: 14356 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791714.306236:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb81b600/0xcd6380150a323dcf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd6380150a323dc8 expref: 17 pid: 14356 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791714.306248:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791714.306292:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7a02850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:3312:x1875683630485504:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791714.306299:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788791714.306531:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb484e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:aa113159-ee5b-4f24-93ba-c8c094c83d87:3313:1875683630485248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788791714.306804:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630485504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788791714.309051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791714.309200:0:16472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb042a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875683630484608:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788791714.309214:0:16472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb042300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16472:1875683630484736:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791714.309252:0:16472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9ababb81a600/0xcd6380150a3240d8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791714.309519:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606378496 00000100:00100000:3.0:1788791714.309527:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606378496 00010000:00010000:3.0:1788791714.309563:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9ababb16c400/0xcd6380150a3240ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536753e3 expref: 13 pid: 14355 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791714.309597:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1788791714.309606:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:2355:x1875683606378496:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791714.309620:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791714.309626:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9ababb16c400/0xcd6380150a3240ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536753e3 expref: 13 pid: 14355 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791714.309636:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9ababb16c400/0xcd6380150a3240ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536753e3 expref: 13 pid: 14355 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791714.309670:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb16c400/0xcd6380150a3240ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536753e3 expref: 13 pid: 14355 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791714.309684:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791714.310450:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+12:2355:x1875683606378496:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 128us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791714.310461:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:3.0:1788791714.314903:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791714.315058:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606378624 00000100:00100000:1.0:1788791714.315068:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606378624 00010000:00010000:1.0:1788791714.315108:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9aba851ca800/0xcd6380150a324076 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675381 expref: 12 pid: 14355 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791714.315922:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:1.0:1788791714.315935:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+12:2353:x1875683606378624:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791714.315951:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791714.315958:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9aba851ca800/0xcd6380150a324076 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675381 expref: 12 pid: 14355 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791714.315973:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9aba851ca800/0xcd6380150a324076 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675381 expref: 12 pid: 14355 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791714.315991:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9aba851ca800/0xcd6380150a324076 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675381 expref: 12 pid: 14355 timeout: 590 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791714.316009:0:14348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9ababb81a600/0xcd6380150a3240d8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791714.316018:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb81a600/0xcd6380150a3240d8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791714.316035:0:14348:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ababb81a600/0xcd6380150a3240d8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791714.316060:0:14348:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9ababb81a600/0xcd6380150a3240d8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791714.316067:0:14348:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9ababb81a600/0xcd6380150a3240d8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791714.316074:0:14348:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9ababb81a600/0xcd6380150a3240d8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791714.316080:0:14348:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81a600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791714.316085:0:14348:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9ababb81a600/0xcd6380150a3240d8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791714.316093:0:14348:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9ababb81a600/0xcd6380150a3240d8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791714.316119:0:14348:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9ababb81a600/0xcd6380150a3240d8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791714.316148:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791714.316477:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+11:2353:x1875683606378624:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 544us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791714.316486:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00010000:00010000:2.0:1788791714.316578:0:16472:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9ababb81a600/0xcd6380150a3240d8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.316587:0:16472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9ababb81a600/0xcd6380150a3240d8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791714.316594:0:16472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9ababb81a600/0xcd6380150a3240d8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791714.921385:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791715.107813:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630485632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788791715.107900:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791715.111076:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630485632 00000100:00100000:3.0:1788791715.111093:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630485632 00000100:00080000:1.0:1788791715.111364:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791715.116347:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788791715.116371:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630485632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788791715.116530:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791715.117924:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb487800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630485632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1556us (10015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791715.117941:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788791715.120735:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630485632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788791715.509155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791715.509369:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606378752 00000100:00100000:2.0:1788791715.509384:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606378752 00000100:00100000:2.0:1788791715.509456:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 105 00000100:00100000:2.0:1788791715.509466:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab797d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+11:13771:x1875683606378752:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791715.509494:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791715.509513:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb81bc00/0xcd6380150a3240df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a9453675414 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791715.509545:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb81bc00/0xcd6380150a3240df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675414 expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791715.509557:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb81bc00/0xcd6380150a3240df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675414 expref: 12 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791715.509567:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81bc00, rc 0) 00000100:00100000:2.0:1788791715.509621:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab797d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+12:13771:x1875683606378752:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 157us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791715.509629:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 105 00000100:00100000:0.0:1788791715.514811:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791715.514860:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606378880 00000100:00100000:0.0:1788791715.514870:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606378880 00000100:00100000:0.0:1788791715.514929:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 106 00000100:00100000:0.0:1788791715.514941:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3058850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+12:13771:x1875683606378880:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788791715.516754:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3058850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+12:13771:x1875683606378880:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 1808us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791715.516766:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 106 00000100:00100000:0.0:1788791715.526987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791715.527062:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606379008 00000100:00100000:1.0:1788791715.527074:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606379008 00000100:00100000:1.0:1788791715.527179:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 107 00000100:00100000:1.0:1788791715.527192:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3059450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+12:13771:x1875683606379008:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791715.527423:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3059450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+12:13771:x1875683606379008:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 232us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791715.527431:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 107 00000100:00100000:1.0:1788791715.557259:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791715.557460:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606379136 00000100:00100000:0.0:1788791715.557472:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606379136 00000100:00100000:0.0:1788791715.557537:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 108 00000100:00100000:0.0:1788791715.557548:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab305b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+12:13771:x1875683606379136:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788791715.557565:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791715.557583:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba851cb200/0xcd6380150a3240e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcf751a945367541b expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791715.557614:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba851cb200/0xcd6380150a3240e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367541b expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791715.557626:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba851cb200/0xcd6380150a3240e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367541b expref: 13 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791715.557638:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba851cb200, rc 0) 00000100:00100000:0.0:1788791715.557714:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab305b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:13771:x1875683606379136:12345-192.168.201.29@tcp:101:ll_cfg_requeue.0 Request processed in 168us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791715.557721:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 108 00000100:00100000:0.0:1788791715.560974:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791715.561370:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606379264 00000100:00100000:3.0:1788791715.561381:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606379264 00000100:00100000:3.0:1788791715.561437:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 109 00000100:00100000:3.0:1788791715.561447:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3059c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:13771:x1875683606379264:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791715.561763:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3059c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:13771:x1875683606379264:12345-192.168.201.29@tcp:501:ll_cfg_requeue.0 Request processed in 316us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791715.561773:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 109 00000100:00100000:0.0:1788791715.577489:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791715.577721:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606379392 00000100:00100000:3.0:1788791715.577734:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606379392 00000100:00100000:3.0:1788791715.577800:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 110 00000100:00100000:3.0:1788791715.577812:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab305b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:13771:x1875683606379392:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788791715.578070:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab305b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:13771:x1875683606379392:12345-192.168.201.29@tcp:503:ll_cfg_requeue.0 Request processed in 260us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791715.578081:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 110 00000100:00100000:3.0:1788791715.621405:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788791715.621429:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630485760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791715.621500:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791715.622518:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630485888:0@lo:400:kworker.0 00000100:00100000:3.0:1788791715.622562:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791715.622956:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630485760 00000100:00100000:2.0:1788791715.622964:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630485760 00000100:00100000:2.0:1788791715.623023:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788791715.623035:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ab982a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630485760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788791715.623074:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788791715.623119:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ab982a3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630485760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791715.623307:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788791715.623335:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630486016:0@lo:400:kworker.0 00000100:00100000:2.0:1788791715.623368:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788791715.623407:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788791715.623423:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630486016 00000100:00100000:2.0:1788791715.623427:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630486016 00000100:00100000:2.0:1788791715.623468:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788791715.623476:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb484e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630486016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791715.623515:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb484e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630486016:12345-0@lo:400:kworker.0 Request processed in 40us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791715.623522:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788791715.624674:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630486400:0@lo:400:kworker.0 00000100:00100000:3.0:1788791715.624724:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791715.624866:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630486016:0@lo:400:kworker.0 00000100:00100000:2.0:1788791715.627414:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630486144:0@lo:400:kworker.0 00000100:00100000:2.0:1788791715.627490:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791715.627576:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630485760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788791715.627600:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791715.627607:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab2d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630486272:0@lo:400:kworker.0 00000100:00100000:2.0:1788791715.627634:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791715.627669:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630486400 00000100:00100000:2.0:1788791715.627676:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630486400 00000100:00100000:2.0:1788791715.627724:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630486144 00000100:00100000:2.0:1788791715.627727:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630486144 00000100:00100000:2.0:1788791715.627739:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630486272 00000100:00100000:2.0:1788791715.627741:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630486272 00000100:00100000:2.0:1788791715.627756:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788791715.627764:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630486400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791715.627836:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875683630486400:12345-0@lo:400:kworker.0 Request processed in 71us (3111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791715.627843:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788791715.627860:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788791715.627865:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630486144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791715.627898:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb484700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875683630486144:12345-0@lo:400:kworker.0 Request processed in 33us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791715.627913:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788791715.627925:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788791715.627931:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630486272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791715.627959:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb484a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630486272:12345-0@lo:400:kworker.0 Request processed in 29us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791715.627965:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788791715.627983:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788791715.628001:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab2d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630486272:0@lo:400:kworker.0 00000100:00100000:2.0:1788791715.628010:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875683630486144:0@lo:400:kworker.0 00000100:00100000:2.0:1788791715.628039:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875683630486400:0@lo:400:kworker.0 00000100:00100000:3.0:1788791715.631418:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630485888 00000100:00100000:3.0:1788791715.631435:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630485888 00000100:00100000:3.0:1788791715.631496:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788791715.631507:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3059850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:3312:x1875683630485888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791715.631603:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3059850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:3312:x1875683630485888:12345-0@lo:400:kworker.0 Request processed in 98us (9040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791715.631610:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788791715.634590:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ab982a3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:aa113159-ee5b-4f24-93ba-c8c094c83d87:3312:1875683630485888:0@lo:400:kworker.0 00010000:00010000:0.0:1788791715.939270:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788791716.259721:0:14358:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788791716.259730:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9abab2989800 from 10 10000000:01000000:0.0:1788791716.259735:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788791716.259798:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851ca400/0xcd6380150a3240ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791716.259863:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9aba851ca400/0xcd6380150a3240ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791716.259876:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9aba851ca400/0xcd6380150a3240ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791716.259906:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb712680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630486528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788791716.259985:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791716.260053:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788791716.260066:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630486528 00000100:00100000:2.0:1788791716.260075:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630486528 00000100:00100000:2.0:1788791716.260164:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788791716.260175:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab305bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+16:14358:x1875683630486528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791716.260187:0:14356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791716.260202:0:14356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9ababb81a200/0xcd6380150a3240f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a3240ed expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791716.260227:0:14356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9ababb81a200/0xcd6380150a3240f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a3240ed expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791716.260238:0:14356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9ababb81a200/0xcd6380150a3240f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a3240ed expref: 17 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791716.260248:0:14356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81a200, rc 0) 00000100:00100000:2.0:1788791716.260286:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab305bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:14358:x1875683630486528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791716.260308:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788791716.260867:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb712680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630486528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788791716.260887:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9aba851ca400/0xcd6380150a3240ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3240f4 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791716.260897:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9aba851ca400/0xcd6380150a3240ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a3240f4 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791716.260961:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb712680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630486656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788791716.261002:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791716.261108:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788791716.264633:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630486656 00000100:00100000:1.0:1788791716.264649:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630486656 00000100:00100000:1.0:1788791716.264718:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788791716.264729:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab305a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:14358:x1875683630486656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791716.265089:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab305a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:14358:x1875683630486656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 360us (4084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791716.265098:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788791716.265164:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb712680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630486656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788791716.265222:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb712680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630486784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788791716.265272:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791716.265465:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba88082a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788791716.265759:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630486784 00000100:00100000:1.0:1788791716.265766:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630486784 00000100:00100000:1.0:1788791716.265828:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788791716.265836:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab305ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:14358:x1875683630486784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791716.266015:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab305ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:14358:x1875683630486784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791716.266023:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788791716.270463:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb712680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630486784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788791716.272558:0:16552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788791716.273070:0:14358:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788791716.273094:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788791716.273105:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9aba851ca400/0xcd6380150a3240ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3240f4 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791716.273283:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9aba851ca400/0xcd6380150a3240ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a3240f4 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788791716.273296:0:14358:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788791716.273299:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9aba993ab000 from 10 10000000:01000000:2.0:1788791716.273302:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788791716.273345:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb81ba00/0xcd6380150a3240fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791716.273354:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb81ba00/0xcd6380150a3240fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791716.273364:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb81ba00/0xcd6380150a3240fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791716.273526:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630486912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788791716.273597:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791716.273680:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba817b0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788791716.273733:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630486912 00000100:00100000:1.0:1788791716.273742:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630486912 00000100:00100000:1.0:1788791716.273953:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788791716.273964:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab305a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+17:14358:x1875683630486912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788791716.273976:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791716.273989:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba81525600/0xcd6380150a324102 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a3240fb expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791716.274043:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba81525600/0xcd6380150a324102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a3240fb expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791716.274054:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba81525600/0xcd6380150a324102 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a3240fb expref: 18 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791716.274063:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba81525600, rc 0) 00000100:00100000:1.0:1788791716.274113:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab305a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:14358:x1875683630486912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791716.274160:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788791716.274240:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630486912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791716.274257:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb81ba00/0xcd6380150a3240fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324102 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791716.274266:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb81ba00/0xcd6380150a3240fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a324102 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791716.274330:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630487040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791716.274358:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791716.274728:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba817b0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788791716.274921:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630487040 00000100:00100000:3.0:1788791716.274927:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630487040 00000100:00100000:3.0:1788791716.274956:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788791716.274963:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3058450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:14358:x1875683630487040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788791716.275254:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3058450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:14358:x1875683630487040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791716.275262:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788791716.275570:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630487040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791716.275609:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630487168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788791716.275654:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791716.275685:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba817b0b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788791716.275756:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630487168 00000100:00100000:1.0:1788791716.275762:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630487168 00000100:00100000:1.0:1788791716.275972:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788791716.275981:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3058050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:14358:x1875683630487168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788791716.276194:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3058050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:14358:x1875683630487168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 214us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791716.276202:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788791716.276669:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630487168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788791716.278372:0:16553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788791716.278706:0:14358:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788791716.278729:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788791716.278740:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb81ba00/0xcd6380150a3240fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324102 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791716.278769:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb81ba00/0xcd6380150a3240fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324102 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788791716.278877:0:14358:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788791716.278880:0:14358:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9aba89374800 from 10 10000000:01000000:3.0:1788791716.278883:0:14358:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788791716.278921:0:14358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791716.278929:0:14358:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791716.278940:0:14358:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791716.278965:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85780700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630487296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788791716.279106:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791716.279375:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9abab2f62600 going to sleep for 11 seconds 00000100:00100000:1.0:1788791716.279549:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630487296 00000100:00100000:1.0:1788791716.279558:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630487296 00000100:00100000:1.0:1788791716.279647:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788791716.279657:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3058c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+18:14358:x1875683630487296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788791716.279670:0:14354:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791716.279683:0:14354:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9aba81525000/0xcd6380150a324110 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd6380150a324109 expref: -99 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791716.279706:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9aba81525000/0xcd6380150a324110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd6380150a324109 expref: 19 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791716.279730:0:14354:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9aba81525000/0xcd6380150a324110 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd6380150a324109 expref: 19 pid: 14354 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791716.279739:0:14354:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba81525000, rc 0) 00000100:00100000:1.0:1788791716.279802:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3058c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:14358:x1875683630487296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791716.279818:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788791716.279901:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85780700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630487296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788791716.279918:0:14358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324110 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791716.279927:0:14358:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd6380150a324110 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791716.279982:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630487424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791716.280021:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791716.280909:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbcc7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788791716.280950:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630487424 00000100:00100000:3.0:1788791716.280957:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630487424 00000100:00100000:1.0:1788791716.281019:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788791716.281029:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab3059050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:14358:x1875683630487424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788791716.281323:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab3059050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:14358:x1875683630487424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791716.281332:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788791716.281433:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630487424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788791716.281477:0:14358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630487552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788791716.281522:0:14358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791716.282161:0:14358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababbcc7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788791716.282308:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630487552 00000100:00100000:0.0:1788791716.282315:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630487552 00000100:00100000:0.0:1788791716.282350:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788791716.282358:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab305a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:14358:x1875683630487552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788791716.282670:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab305a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:14358:x1875683630487552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 311us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791716.282676:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788791716.285389:0:14358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb484000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:aa113159-ee5b-4f24-93ba-c8c094c83d87:14358:1875683630487552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788791716.286930:0:16554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788791716.287536:0:14358:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788791716.287559:0:14358:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788791716.287572:0:14358:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324110 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791716.287585:0:14358:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.129@tcp lock: ffff9ababb16c400/0xcd6380150a324109 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd6380150a324110 expref: -99 pid: 14358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788791716.454716:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788791716.963371:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788791717.940844:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791717.940890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791717.940914:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791717.940948:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791717.940965:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791717.940987:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791717.941013:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791717.941048:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606379904 00000100:00100000:1.0:1788791717.941059:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606379904 00000100:00100000:1.0:1788791717.941112:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606380160 00000100:00100000:1.0:1788791717.941115:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606380160 00000100:00100000:1.0:1788791717.941166:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606379776 00000100:00100000:1.0:1788791717.941170:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606379776 00000100:00100000:1.0:1788791717.941184:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606380288 00000100:00100000:1.0:1788791717.941187:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606380288 00000100:00100000:1.0:1788791717.941221:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:1.0:1788791717.941231:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2353:x1875683606379904:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791717.941300:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7987100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2353:x1875683606379904:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 71us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791717.941308:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:1.0:1788791717.941323:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:1.0:1788791717.941341:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+5:2353:x1875683606380160:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791717.941366:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7987480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+5:2353:x1875683606380160:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 38us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791717.941383:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:1.0:1788791717.941395:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1788791717.941401:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2353:x1875683606379776:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791717.941421:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7986680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2353:x1875683606379776:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 21us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791717.941427:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:1.0:1788791717.941448:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:1.0:1788791717.941456:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+5:2353:x1875683606380288:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791717.941485:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+5:2353:x1875683606380288:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 30us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791717.941492:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:1.0:1788791717.941509:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606379648 00000100:00100000:1.0:1788791717.941513:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606379648 00000100:00100000:1.0:1788791717.941538:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606380032 00000100:00100000:1.0:1788791717.941542:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606380032 00000100:00100000:1.0:1788791717.941566:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:1.0:1788791717.941572:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+6:2353:x1875683606379648:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791717.941600:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+6:2353:x1875683606379648:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 28us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791717.941606:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:1.0:1788791717.941616:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:1.0:1788791717.941621:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2353:x1875683606380032:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:1.0:1788791717.941637:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2353:x1875683606380032:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 16us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791717.941643:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00080000:1.0:1788791717.941659:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788791717.941663:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788791717.941665:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788791717.941746:0:14355:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606379520 00000100:00100000:0.0:1788791717.941755:0:14355:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606379520 00000100:00100000:0.0:1788791717.941794:0:14355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 121 00000100:00100000:0.0:1788791717.941801:0:14355:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7a01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:2353:x1875683606379520:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:0.0:1788791717.941823:0:14355:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7a01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:2353:x1875683606379520:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 23us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791717.941829:0:14355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 121 00010000:00010000:3.0:1788791717.987795:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791718.548851:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791718.548961:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606380416 00000100:00100000:1.0:1788791718.548972:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606380416 00000100:00100000:1.0:1788791718.549040:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:1.0:1788791718.549050:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+6:14431:x1875683606380416:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788791718.549070:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791718.549091:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a324117 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675422 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.549194:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a32411e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.549209:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a32411e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.549220:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a32411e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.549251:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a324125 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.549258:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a324125 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.549265:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a324125 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.549704:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a32412c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.549714:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a32412c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.549721:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a32412c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791718.549812:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1788791718.549816:0:14361:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791718.549909:0:14361:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a32412c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.549922:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a32411e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.549928:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a32411e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.549934:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a32411e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.549949:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81524a00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791718.549953:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a32411e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.549960:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a32411e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.549972:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613000) 00010000:00010000:1.0:1788791718.549974:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791718.549978:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a32411e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.549984:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a32411e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.549996:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a324125 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.550001:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a324125 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.550006:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a324125 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.550010:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81524000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791718.550012:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a324125 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.550018:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a324125 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.550033:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9aba9010c300) 00010000:00010000:1.0:1788791718.550036:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791718.550039:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a324125 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.550044:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a324125 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.550079:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a324117 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675422 expref: 8 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.550092:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81525c00/0xcd6380150a32412c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675422 expref: 7 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.550099:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9aba9010c600) 00010000:00010000:1.0:1788791718.550101:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788791718.550104:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba81525c00, rc 0) 00000100:00100000:1.0:1788791718.550232:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+7:14431:x1875683606380416:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1183us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791718.550240:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:0.0:1788791718.561351:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791718.561456:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606380672 00000100:00100000:2.0:1788791718.561481:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606380672 00000100:00100000:2.0:1788791718.561547:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:2.0:1788791718.561558:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+7:14431:x1875683606380672:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788791718.561581:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791718.561605:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a324133 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675429 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.561676:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32413a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.561691:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32413a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.561702:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32413a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.561758:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a324141 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.561775:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a324141 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.561782:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a324141 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.562312:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b600/0xcd6380150a324148 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.562335:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b600/0xcd6380150a324148 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.562342:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b600/0xcd6380150a324148 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791718.562352:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1788791718.562592:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32413a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.562600:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32413a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.562607:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32413a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.562612:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81a600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791718.562617:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32413a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.562625:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32413a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.562637:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9aba9010c600) 00010000:00010000:2.0:1788791718.562640:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791718.562644:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32413a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.562650:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32413a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.562661:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a324141 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.562675:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a324141 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.562680:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a324141 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.562685:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81ae00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791718.562688:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a324141 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.562694:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a324141 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.562702:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9aba8533f000) 00010000:00010000:2.0:1788791718.562705:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791718.562707:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a324141 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.562713:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a324141 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.563189:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a324133 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675429 expref: 10 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.563206:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b600/0xcd6380150a324148 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675429 expref: 9 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.563213:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9aba8533f400) 00010000:00010000:2.0:1788791718.563215:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791718.563222:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81b600, rc 0) 00000100:00100000:2.0:1788791718.563305:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+9:14431:x1875683606380672:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1747us (1965us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788791718.563313:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:3.0:1788791718.567290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791718.567626:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606380800 00000100:00100000:2.0:1788791718.567638:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606380800 00000100:00100000:2.0:1788791718.567705:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:2.0:1788791718.567716:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+9:14431:x1875683606380800:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788791718.567837:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+9:14431:x1875683606380800:12345-192.168.201.29@tcp:59:lhsmtool_posix.0 Request processed in 122us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791718.567844:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:3.0:1788791718.631913:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791718.632070:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606380928 00000100:00100000:1.0:1788791718.632091:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606380928 00000100:00100000:1.0:1788791718.632181:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:1.0:1788791718.632193:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+9:14437:x1875683606380928:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788791718.632214:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791718.632233:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a324156 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675430 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632317:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a32415d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632331:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a32415d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632343:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a32415d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632358:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a324164 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632365:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a324164 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632372:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a324164 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632639:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a32415d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632647:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a32415d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632654:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a32415d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632659:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81524000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791718.632663:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a32415d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632679:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a32415d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632692:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613000) 00010000:00010000:1.0:1788791718.632695:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791718.632700:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a32415d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632705:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a32415d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632718:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a324164 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632724:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a324164 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632730:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a324164 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632735:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81524a00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791718.632738:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a324164 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632745:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a324164 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632752:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9aba9010c300) 00010000:00010000:1.0:1788791718.632754:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791718.632757:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a324164 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632783:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a324164 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632816:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a324156 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675430 expref: 10 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.632826:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613000) 00010000:00010000:1.0:1788791718.632828:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791718.632832:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a324156 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675430 expref: 10 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.633270:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba81524c00, rc 0) 00000100:00100000:1.0:1788791718.633341:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+9:14437:x1875683606380928:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 1150us (1438us total) trans 0 rc 301/301 00000100:00100000:1.0:1788791718.633349:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:0.0:1788791718.639293:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791718.639416:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606381056 00000100:00100000:2.0:1788791718.639427:0:14370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606381056 00000100:00100000:2.0:1788791718.639495:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1788791718.639506:0:14370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6788f146-04ff-4ba5-8299-9481a02c8bed+9:14437:x1875683606381056:12345-192.168.201.29@tcp:700:lfs.0 00000100:00100000:2.0:1788791718.639598:0:14370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6788f146-04ff-4ba5-8299-9481a02c8bed+9:14437:x1875683606381056:12345-192.168.201.29@tcp:700:lfs.0 Request processed in 94us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791718.639606:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1788791718.652210:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791718.652346:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606381312 00000100:00100000:1.0:1788791718.652358:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606381312 00000100:00100000:1.0:1788791718.652428:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 19 00000100:00100000:1.0:1788791718.652441:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+9:14437:x1875683606381312:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:1.0:1788791718.652530:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791718.652559:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba851cb800/0xcd6380150a324099 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536753ab expref: 9 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.652580:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613000) 00010000:00010000:1.0:1788791718.652585:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788791718.652892:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a32416b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.652913:0:14362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a3240d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367540d expref: 5 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.652922:0:14362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a32416b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.652955:0:14362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a3240d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367540d expref: 5 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.652969:0:14362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a3240d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367540d expref: 5 pid: 14363 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791718.652983:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab7986300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14362:1875683630487680:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791718.653089:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae03900 going to sleep for 11 seconds 00000100:00100000:1.0:1788791718.662402:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab7986300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14362:1875683630487680:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791718.662434:0:14362:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a32416b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791718.664881:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791718.665196:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606381440 00000100:00100000:1.0:1788791718.665207:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606381440 00010000:00010000:1.0:1788791718.665250:0:14347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a3240d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367540d expref: 6 pid: 14363 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791718.665293:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:1.0:1788791718.665303:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2354:x1875683606381440:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791718.665318:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791718.665338:0:14347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a3240d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367540d expref: 6 pid: 14363 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.665352:0:14347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a3240d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367540d expref: 6 pid: 14363 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.665383:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a3240d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367540d expref: 6 pid: 14363 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.665400:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613000) 00010000:00010000:1.0:1788791718.665405:0:14347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a32416b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.665414:0:14347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a32416b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.665421:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a32416b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.665563:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791718.665623:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+5:2354:x1875683606381440:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 321us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791718.665631:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00010000:00010000:2.0:1788791718.668231:0:14362:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a32416b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.668250:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a32416b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.668286:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a324172 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.668299:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a324172 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.668324:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a324172 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791718.672241:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788791718.672260:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a32416b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.672270:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a32416b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.672277:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a32416b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.672282:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81524c00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791718.672286:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a32416b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.672293:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a32416b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.672308:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9abaa0613000) 00010000:00010000:2.0:1788791718.672311:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791718.672316:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a32416b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.672321:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a32416b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788791718.672340:0:14362:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000007eba7fc8 reply state 00000000d1bcc063 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a324172 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791718.672360:0:14362:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788791718.678707:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+10:14437:x1875683606381312:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 20027us (20267us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788791718.678721:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 19 00010000:00010000:0.0:1788791718.691963:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a324172 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791718.691994:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a324172 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791718.692002:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a324172 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791718.692009:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791718.692014:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a324172 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791718.692021:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a324172 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791718.692038:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9aba8533f000) 00010000:00010000:0.0:1788791718.692041:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791718.692046:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a324172 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791718.692071:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a324172 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791718.836542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791718.836659:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606381568 00000100:00100000:1.0:1788791718.836669:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606381568 00000100:00100000:1.0:1788791718.836728:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:1.0:1788791718.836738:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+9:14445:x1875683606381568:12345-192.168.201.29@tcp:101:lctl.0 00010000:00010000:1.0:1788791718.836773:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791718.836802:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a324179 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675437 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.836883:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a324180 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.836898:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a324180 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.836909:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a324180 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791718.836972:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1788791718.836976:0:14361:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791718.837019:0:14361:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a324180 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.837044:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a324179 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675437 expref: 11 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.837062:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524a00/0xcd6380150a324180 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675437 expref: 10 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.837071:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba9010c300) 00010000:00010000:1.0:1788791718.837074:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788791718.837077:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba81524a00, rc 0) 00000100:00100000:1.0:1788791718.837182:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+10:14445:x1875683606381568:12345-192.168.201.29@tcp:101:lctl.0 Request processed in 445us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791718.837189:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 20 00000100:00100000:1.0:1788791718.901696:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791718.905106:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606381696 00000100:00100000:2.0:1788791718.905121:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606381696 00000100:00100000:2.0:1788791718.905250:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:2.0:1788791718.905261:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+5:14446:x1875683606381696:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791718.905295:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791718.905319:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a324187 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367543e expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.905396:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32418e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.905410:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32418e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.905422:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32418e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791718.905483:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1788791718.905488:0:14362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1788791718.905510:0:14362:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32418e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.905533:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ae00/0xcd6380150a324187 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367543e expref: 7 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.905577:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a600/0xcd6380150a32418e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367543e expref: 6 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.905587:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba9010c300) 00010000:00010000:2.0:1788791718.905590:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788791718.905594:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb81a600, rc 0) 00000100:00100000:2.0:1788791718.905671:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7986300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:14446:x1875683606381696:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 412us (3989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791718.905679:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 21 00000100:00100000:0.0:1788791718.909648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791718.910090:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606381824 00000100:00100000:2.0:1788791718.910100:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606381824 00000100:00100000:2.0:1788791718.910184:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:2.0:1788791718.910194:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:14446:x1875683606381824:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791718.910215:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791718.910235:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a400/0xcd6380150a324195 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675445 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910312:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32419c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910327:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32419c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910337:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32419c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910351:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3241a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910369:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3241a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910376:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3241a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910514:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3241aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910523:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3241aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910529:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3241aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791718.910568:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788791718.910571:0:14363:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788791718.910592:0:14363:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3241aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910605:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32419c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910610:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32419c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910616:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32419c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910622:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81ac00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791718.910626:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32419c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910642:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32419c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910654:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba9010c300) 00010000:00010000:2.0:1788791718.910657:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791718.910661:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32419c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910667:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81ac00/0xcd6380150a32419c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910680:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3241a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910685:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3241a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910690:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3241a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910694:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb81b400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791718.910696:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3241a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910701:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3241a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910708:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9aba8533fc00) 00010000:00010000:2.0:1788791718.910710:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791718.910712:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3241a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910726:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81b400/0xcd6380150a3241a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910756:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb81a400/0xcd6380150a324195 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675445 expref: 8 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910786:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3241aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675445 expref: 7 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.910793:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9aba8533f300) 00010000:00010000:2.0:1788791718.910795:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788791718.910797:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fea00, rc 0) 00000100:00100000:2.0:1788791718.910880:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab8deec1-d492-4ec8-be91-5e484d9b7641+7:14446:x1875683606381824:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 687us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791718.910887:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 22 00000100:00100000:0.0:1788791718.923311:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791718.923414:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606382080 00000100:00100000:1.0:1788791718.923437:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606382080 00000100:00100000:1.0:1788791718.923500:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:1.0:1788791718.923511:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab8deec1-d492-4ec8-be91-5e484d9b7641+7:14446:x1875683606382080:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788791718.923531:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791718.923552:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a3241b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367544c expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791718.923667:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1788791718.923805:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a3241b1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367544c expref: 9 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.923821:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba9010c300) 00010000:00010000:1.0:1788791718.923824:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788791718.923828:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a3241b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367544c expref: 9 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.923842:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba81524e00, rc 0) 00000100:00100000:1.0:1788791718.923906:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab8deec1-d492-4ec8-be91-5e484d9b7641+8:14446:x1875683606382080:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 397us (606us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788791718.923914:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 23 00000100:00100000:3.0:1788791718.926593:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791718.926706:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606382336 00000100:00100000:1.0:1788791718.926716:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606382336 00000100:00100000:1.0:1788791718.926795:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 24 00000100:00100000:1.0:1788791718.926806:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+8:14446:x1875683606382336:12345-192.168.201.29@tcp:36:lfs.0 00010000:00010000:1.0:1788791718.926859:0:14362:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791718.926897:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fea00/0xcd6380150a3241aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675445 expref: 8 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.926933:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9aba8533f300) 00010000:00010000:1.0:1788791718.926944:0:14362:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788791718.926980:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241bf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.926993:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791718.927003:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788791718.927258:0:14362:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000764b32a8 reply state 000000004dec34bb transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791718.927281:0:14362:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788791718.927295:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:1.0:1788791718.927381:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+9:14446:x1875683606382336:12345-192.168.201.29@tcp:36:lfs.0 Request processed in 576us (797us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788791718.927389:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 24 00010000:00010000:2.0:1788791718.930576:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.930592:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241bf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.930600:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.930606:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81524000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791718.930610:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.930617:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241bf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.930652:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9aba9010c200) 00010000:00010000:2.0:1788791718.930655:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788791718.930661:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241bf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.930667:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241bf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791718.932160:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791718.932440:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606382592 00000100:00100000:2.0:1788791718.932451:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606382592 00000100:00100000:2.0:1788791718.932507:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:2.0:1788791718.932519:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab8deec1-d492-4ec8-be91-5e484d9b7641+8:14446:x1875683606382592:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788791718.932776:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab8deec1-d492-4ec8-be91-5e484d9b7641+9:14446:x1875683606382592:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 259us (660us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788791718.932784:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:0.0:1788791718.939991:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791718.940201:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606382848 00000100:00100000:2.0:1788791718.940211:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606382848 00000100:00100000:2.0:1788791718.940276:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:2.0:1788791718.940286:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab8deec1-d492-4ec8-be91-5e484d9b7641+9:14446:x1875683606382848:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791718.940309:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791718.940329:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff800/0xcd6380150a3241c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675453 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940401:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3241cd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940414:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3241cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940439:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3241cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940454:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3241d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940460:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3241d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940466:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3241d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791718.940595:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788791718.940688:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3241cd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940697:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3241cd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940703:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3241cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940709:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791718.940713:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3241cd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940720:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3241cd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940733:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba9010c300) 00010000:00010000:2.0:1788791718.940736:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791718.940747:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3241cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940754:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3241cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940778:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3241d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940785:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3241d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940791:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3241d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940796:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791718.940800:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3241d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940806:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3241d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940814:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9aba8533fc00) 00010000:00010000:2.0:1788791718.940816:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791718.940819:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3241d4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940825:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3241d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940875:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff800/0xcd6380150a3241c6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675453 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940897:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba9010c300) 00010000:00010000:2.0:1788791718.940900:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788791718.940904:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff800/0xcd6380150a3241c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675453 expref: 11 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.940914:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff800, rc 0) 00000100:00100000:2.0:1788791718.940996:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ab8deec1-d492-4ec8-be91-5e484d9b7641+10:14446:x1875683606382848:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 712us (1015us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788791718.941005:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 25 00000100:00100000:0.0:1788791718.945435:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791718.945519:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606382976 00000100:00100000:2.0:1788791718.945530:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606382976 00000100:00100000:2.0:1788791718.945600:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:2.0:1788791718.945611:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab8deec1-d492-4ec8-be91-5e484d9b7641+10:14446:x1875683606382976:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791718.945636:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791718.945659:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe800/0xcd6380150a3241e2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367545a expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.945754:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a3241e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.945778:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a3241e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.945790:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a3241e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791718.945840:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1788791718.945857:0:14361:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788791718.945886:0:14361:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a3241e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.945913:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe800/0xcd6380150a3241e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367545a expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.945930:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a3241e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367545a expref: 11 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791718.945938:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9aba8533fb00) 00010000:00010000:2.0:1788791718.945941:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788791718.945944:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ffe00, rc 0) 00000100:00100000:2.0:1788791718.946018:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ab8deec1-d492-4ec8-be91-5e484d9b7641+11:14446:x1875683606382976:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 409us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791718.946025:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 26 00000100:00100000:3.0:1788791718.954236:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791718.954301:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606383104 00000100:00100000:2.0:1788791718.954313:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606383104 00000100:00100000:2.0:1788791718.954379:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:2.0:1788791718.954392:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab8deec1-d492-4ec8-be91-5e484d9b7641+11:14446:x1875683606383104:12345-192.168.201.29@tcp:37:lfs.0 00000100:00100000:2.0:1788791718.959480:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ab8deec1-d492-4ec8-be91-5e484d9b7641+11:14446:x1875683606383104:12345-192.168.201.29@tcp:37:lfs.0 Request processed in 5079us (5243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791718.959494:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:0.0:1788791718.963648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791718.963722:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606383360 00000100:00100000:1.0:1788791718.963735:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606383360 00000100:00100000:1.0:1788791718.963835:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:1.0:1788791718.963846:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86791850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+11:14446:x1875683606383360:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788791718.964107:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86791850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+12:14446:x1875683606383360:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 262us (469us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788791718.964116:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00010000:00010000:0.0:1788791719.011531:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791719.031316:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791719.031499:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606383488 00000100:00100000:1.0:1788791719.031515:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606383488 00000100:00100000:1.0:1788791719.031603:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:1.0:1788791719.031617:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+10:14452:x1875683606383488:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788791719.031641:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791719.031666:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a3241f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675461 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.031733:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.031768:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.031780:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.031796:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a3241fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.031803:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a3241fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.031809:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a3241fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788791719.032106:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788791719.032175:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d400/0xcd6380150a324205 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032188:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d400/0xcd6380150a324205 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032195:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d400/0xcd6380150a324205 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791719.032239:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1788791719.032242:0:14362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791719.032286:0:14362:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d400/0xcd6380150a324205 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032298:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032304:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032310:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032315:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81524000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791719.032319:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032326:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032338:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba9010c300) 00010000:00010000:1.0:1788791719.032341:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791719.032345:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032352:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524000/0xcd6380150a3241f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032365:0:14362:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a3241fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032382:0:14362:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a3241fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032389:0:14362:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a3241fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032394:0:14362:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba81524c00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:1.0:1788791719.032397:0:14362:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a3241fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032403:0:14362:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a3241fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032412:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9aba9010cd00) 00010000:00010000:1.0:1788791719.032414:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788791719.032417:0:14362:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a3241fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032423:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524c00/0xcd6380150a3241fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032457:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba81524e00/0xcd6380150a3241f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675461 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032470:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d400/0xcd6380150a324205 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675461 expref: 11 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.032478:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9aba8533fb00) 00010000:00010000:1.0:1788791719.032480:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788791719.032489:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92d400, rc 0) 00000100:00100000:1.0:1788791719.032545:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+11:14452:x1875683606383488:12345-192.168.201.29@tcp:101:bash.0 Request processed in 932us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791719.032552:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 27 00000100:00100000:0.0:1788791719.040734:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791719.042674:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606383744 00000100:00100000:1.0:1788791719.042690:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606383744 00000100:00100000:1.0:1788791719.042783:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:1.0:1788791719.042796:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+11:14452:x1875683606383744:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:1.0:1788791719.042820:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791719.042842:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d000/0xcd6380150a32420c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675468 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.043106:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a324213 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.043122:0:14363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a3241e9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367545a expref: 11 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.043150:0:14363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a324213 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.043185:0:14363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a3241e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367545a expref: 11 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.043200:0:14363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a3241e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367545a expref: 11 pid: 14361 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791719.043213:0:14363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab7984380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14363:1875683630487808:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791719.043418:0:14363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae03b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788791719.047877:0:14363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab7984380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14363:1875683630487808:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791719.047913:0:14363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a324213 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791719.057052:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791719.057639:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606383872 00000100:00100000:1.0:1788791719.057650:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606383872 00010000:00010000:1.0:1788791719.057717:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a3241e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367545a expref: 12 pid: 14361 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791719.057778:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00080000:2.0:1788791719.057790:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788791719.057790:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab8deec1-d492-4ec8-be91-5e484d9b7641+12:2354:x1875683606383872:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791719.057809:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791719.057816:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a3241e9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367545a expref: 12 pid: 14361 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.057830:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a3241e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367545a expref: 12 pid: 14361 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.057851:0:14348:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffe00/0xcd6380150a3241e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367545a expref: 12 pid: 14361 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.057867:0:14348:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9aba8533fb00) 00010000:00010000:1.0:1788791719.057872:0:14348:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a324213 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.057882:0:14348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a324213 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.057909:0:14348:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a324213 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.057939:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791719.058055:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ab8deec1-d492-4ec8-be91-5e484d9b7641+11:2354:x1875683606383872:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 268us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791719.058063:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00010000:00010000:2.0:1788791719.058373:0:14363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a324213 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.058383:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a324213 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.058416:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff800/0xcd6380150a32421a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.058427:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff800/0xcd6380150a32421a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.058435:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff800/0xcd6380150a32421a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.059202:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a324221 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.059214:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a324221 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.059221:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a324221 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791719.059232:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788791719.059257:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a324213 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.059264:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a324213 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.059270:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a324213 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.059275:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb92de00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791719.059279:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a324213 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.059298:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a324213 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.059309:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9aba8533fb00) 00010000:00010000:2.0:1788791719.059311:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791719.059315:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a324213 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.059321:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92de00/0xcd6380150a324213 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788791719.059332:0:14363:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000fe9b1f41 reply state 00000000f398777e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff800/0xcd6380150a32421a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791719.059341:0:14363:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788791719.059377:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92d000/0xcd6380150a32420c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675468 expref: 14 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.059391:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a324221 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675468 expref: 13 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.059398:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791719.059400:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788791719.059403:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff200, rc 0) 00000100:00100000:2.0:1788791719.059453:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+14:14452:x1875683606383744:12345-192.168.201.29@tcp:101:bash.0 Request processed in 16661us (18730us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788791719.059461:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00010000:00010000:0.0:1788791719.066168:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff800/0xcd6380150a32421a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791719.066189:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff800/0xcd6380150a32421a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791719.066198:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff800/0xcd6380150a32421a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791719.066205:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff800 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791719.066211:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff800/0xcd6380150a32421a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791719.066219:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff800/0xcd6380150a32421a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791719.066236:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9aba8533fc00) 00010000:00010000:0.0:1788791719.066255:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788791719.066261:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff800/0xcd6380150a32421a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791719.066267:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff800/0xcd6380150a32421a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791719.109685:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791719.110100:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606384000 00000100:00100000:2.0:1788791719.110164:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606384000 00000100:00100000:2.0:1788791719.110235:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:2.0:1788791719.110245:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+13:14452:x1875683606384000:12345-192.168.201.29@tcp:101:bash.0 00010000:00010000:2.0:1788791719.110271:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791719.110292:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32422f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367546f expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.110366:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324236 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.110380:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324236 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.110391:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324236 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791719.110429:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788791719.110433:0:14361:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788791719.110449:0:14361:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324236 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.110459:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324236 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.110481:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32422f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367546f expref: 15 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.110498:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324236 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367546f expref: 14 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.110506:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791719.110514:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788791719.110519:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fec00, rc 0) 00000100:00100000:2.0:1788791719.110579:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+14:14452:x1875683606384000:12345-192.168.201.29@tcp:101:bash.0 Request processed in 335us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791719.110586:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:2.0:1788791719.115019:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791719.115167:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606384256 00000100:00100000:1.0:1788791719.115178:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606384256 00000100:00100000:1.0:1788791719.115233:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:1.0:1788791719.115243:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+14:14452:x1875683606384256:12345-192.168.201.29@tcp:35:bash.0 00000100:00100000:1.0:1788791719.115588:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb484000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+15:14452:x1875683606384256:12345-192.168.201.29@tcp:35:bash.0 Request processed in 346us (579us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788791719.115597:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:0.0:1788791719.252714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791719.252833:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606384512 00000100:00100000:2.0:1788791719.252845:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606384512 00000100:00100000:2.0:1788791719.252913:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:2.0:1788791719.252924:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+15:14462:x1875683606384512:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:2.0:1788791719.252951:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791719.252973:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32423d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675476 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791719.253088:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1788791719.253266:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32423d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675476 expref: 17 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.253280:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9aba9010c300) 00010000:00010000:2.0:1788791719.253289:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788791719.253295:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32423d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675476 expref: 17 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.253307:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff000, rc 0) 00000100:00100000:2.0:1788791719.253369:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+16:14462:x1875683606384512:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 446us (667us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788791719.253376:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 30 00000100:00100000:0.0:1788791719.263402:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791719.263932:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606384768 00000100:00100000:1.0:1788791719.263942:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606384768 00000100:00100000:1.0:1788791719.264004:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:1.0:1788791719.264015:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+16:14462:x1875683606384768:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:1.0:1788791719.264606:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+17:14462:x1875683606384768:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 591us (1213us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788791719.264627:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1788791719.347481:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791719.348050:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606385024 00000100:00100000:1.0:1788791719.348061:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606385024 00000100:00100000:1.0:1788791719.348182:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:1.0:1788791719.348195:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+17:14465:x1875683606385024:12345-192.168.201.29@tcp:101:lfs.0 00010000:00010000:1.0:1788791719.348242:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791719.348266:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a32424b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367547d expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.348382:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324252 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.348396:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324252 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.348407:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324252 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791719.348418:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788791719.348545:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a32424b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367547d expref: 20 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.348566:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324252 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367547d expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.348575:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:1.0:1788791719.348578:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788791719.348582:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92dc00, rc 0) 00000100:00100000:1.0:1788791719.348655:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+19:14465:x1875683606385024:12345-192.168.201.29@tcp:101:lfs.0 Request processed in 462us (1187us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788791719.348663:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 31 00000100:00100000:0.0:1788791719.354111:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791719.354465:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606385152 00000100:00100000:2.0:1788791719.354476:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606385152 00000100:00100000:2.0:1788791719.354534:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:2.0:1788791719.354544:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+19:14465:x1875683606385152:12345-192.168.201.29@tcp:54:lfs.0 00010000:00010000:2.0:1788791719.354649:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324260 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.354667:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.354679:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.354706:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324260 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.354713:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324260 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.354719:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324260 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.354725:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791719.354729:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324260 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.354737:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324260 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.354749:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791719.354763:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788791719.354782:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324260 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.354789:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324260 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791719.354878:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+19:14465:x1875683606385152:12345-192.168.201.29@tcp:54:lfs.0 Request processed in 334us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791719.354886:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 32 00000100:00100000:0.0:1788791719.360052:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791719.360443:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606385280 00000100:00100000:3.0:1788791719.360454:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606385280 00000100:00100000:3.0:1788791719.360582:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:0.0:1788791719.360934:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791719.361370:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc146680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+19:2355:x1875683606385280:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791719.361392:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791719.361423:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92dc00/0xcd6380150a324252 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367547d expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791719.361445:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:3.0:1788791719.361450:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791719.361514:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc146680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+18:2355:x1875683606385280:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 153us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791719.361521:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1788791719.361607:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606385536 00000100:00100000:2.0:1788791719.361630:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606385536 00000100:00100000:2.0:1788791719.361670:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:2.0:1788791719.361678:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+18:14465:x1875683606385536:12345-192.168.201.29@tcp:35:lfs.0 00000100:00100000:2.0:1788791719.361896:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+19:14465:x1875683606385536:12345-192.168.201.29@tcp:35:lfs.0 Request processed in 218us (963us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788791719.361902:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00000040:00080000:0.0:1788791719.523897:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788791719.606439:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791719.607174:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606385792 00000100:00100000:2.0:1788791719.607683:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606385792 00000100:00100000:2.0:1788791719.607823:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:2.0:1788791719.607833:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+19:14496:x1875683606385792:12345-192.168.201.29@tcp:101:cat.0 00010000:00010000:2.0:1788791719.607855:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791719.607873:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324267 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675484 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.607955:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a32426e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.607967:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a32426e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.607991:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a32426e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791719.608000:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788791719.608299:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a324267 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675484 expref: 22 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.608315:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a32426e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675484 expref: 21 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.608322:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791719.608325:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788791719.608328:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe000, rc 0) 00000100:00100000:2.0:1788791719.608400:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc146d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+21:14496:x1875683606385792:12345-192.168.201.29@tcp:101:cat.0 Request processed in 568us (1970us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788791719.608408:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 33 00000100:00100000:0.0:1788791719.617292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791719.617366:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791719.617526:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606385920 00000100:00100000:3.0:1788791719.617536:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606385920 00000100:00100000:3.0:1788791719.617609:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:3.0:1788791719.617619:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+21:2352:x1875683606385920:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791719.617639:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791719.617669:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a32426e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675484 expref: 21 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791719.617689:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:3.0:1788791719.617694:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791719.617763:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+20:2352:x1875683606385920:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 145us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791719.617772:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:2.0:1788791719.617914:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606386176 00000100:00100000:2.0:1788791719.617919:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606386176 00000100:00100000:2.0:1788791719.617962:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:2.0:1788791719.617970:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+20:14496:x1875683606386176:12345-192.168.201.29@tcp:35:cat.0 00000100:00100000:2.0:1788791719.618461:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc146a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+21:14496:x1875683606386176:12345-192.168.201.29@tcp:35:cat.0 Request processed in 489us (1092us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788791719.618469:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 8 00000100:00100000:3.0:1788791719.676389:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791719.676797:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606386432 00000100:00100000:1.0:1788791719.676808:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606386432 00000100:00100000:1.0:1788791719.676875:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:1.0:1788791719.676900:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+21:14502:x1875683606386432:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:1.0:1788791719.676927:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791719.676948:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a32427c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a945367548b expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.677049:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ce00/0xcd6380150a324283 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.677248:0:14362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a324221 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675468 expref: 22 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.677258:0:14362:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324236 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367546f expref: 22 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.677267:0:14362:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ce00/0xcd6380150a324283 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.677480:0:14362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324236 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367546f expref: 22 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.677494:0:14362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324236 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367546f expref: 22 pid: 14361 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791719.677518:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab7984380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14362:1875683630487936:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791719.677619:0:14362:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a324221 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675468 expref: 22 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.677628:0:14362:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a324221 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675468 expref: 22 pid: 14363 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791719.677645:0:14362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab7985180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14362:1875683630488064:192.168.201.29@tcp:104: 00000100:00100000:1.0:1788791719.677671:0:14362:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ababae03cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788791719.683638:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791719.683677:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791719.683778:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606386560 00000100:00100000:2.0:1788791719.683788:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606386560 00010000:00010000:2.0:1788791719.683832:0:14347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324236 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367546f expref: 23 pid: 14361 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791719.683885:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606386688 00000100:00100000:2.0:1788791719.683889:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606386688 00010000:00010000:2.0:1788791719.683904:0:14347:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a324221 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675468 expref: 24 pid: 14363 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791719.683919:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:2.0:1788791719.683928:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7a03450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+24:2354:x1875683606386560:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791719.683941:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791719.683948:0:14347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324236 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367546f expref: 24 pid: 14361 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.683961:0:14347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324236 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367546f expref: 24 pid: 14361 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.683987:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791719.683992:0:14347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ce00/0xcd6380150a324283 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.684000:0:14347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ce00/0xcd6380150a324283 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.684006:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791719.684071:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7a03450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+24:2354:x1875683606386560:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 143us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791719.684079:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:2.0:1788791719.684121:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1788791719.684154:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+23:2354:x1875683606386688:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788791719.684168:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791719.684173:0:14347:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a324221 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675468 expref: 23 pid: 14363 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.684182:0:14347:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a324221 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675468 expref: 23 pid: 14363 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.684192:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791719.684196:0:14347:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ce00/0xcd6380150a324283 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.684203:0:14347:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ce00/0xcd6380150a324283 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.684209:0:14347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ce00/0xcd6380150a324283 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.684225:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791719.684243:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+23:2354:x1875683606386688:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 116us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791719.684249:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00010000:00010000:1.0:1788791719.686257:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324236 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a945367546f expref: 22 pid: 14361 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791719.686427:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab7984380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14362:1875683630487936:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791719.686449:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a324221 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.29@tcp remote: 0xcf751a9453675468 expref: 21 pid: 14363 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791719.686461:0:14362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab7985180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14362:1875683630488064:192.168.201.29@tcp:104: 00010000:00010000:1.0:1788791719.686486:0:14362:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ce00/0xcd6380150a324283 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.686496:0:14362:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ce00/0xcd6380150a324283 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.686567:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ce00/0xcd6380150a324283 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791719.686591:0:14362:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788791719.686781:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a32427c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367548b expref: 22 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.686796:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ce00/0xcd6380150a324283 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a945367548b expref: 21 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.686824:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:1.0:1788791719.686827:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788791719.686830:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92ce00, rc 0) 00000100:00100000:1.0:1788791719.686947:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+21:14502:x1875683606386432:12345-192.168.201.29@tcp:101:dd.0 Request processed in 10048us (10568us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788791719.686955:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 34 00000100:00100000:0.0:1788791719.692177:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791719.692269:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606386944 00000100:00100000:2.0:1788791719.692278:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606386944 00000100:00100000:2.0:1788791719.692344:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 35 00000100:00100000:2.0:1788791719.692356:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+21:14502:x1875683606386944:12345-192.168.201.29@tcp:36:dd.0 00010000:00010000:2.0:1788791719.692633:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a324291 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.692649:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a324291 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.692672:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a324291 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788791719.692724:0:14363:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788791719.692772:0:14363:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 000000009234b38b reply state 0000000016e75c3b transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a324291 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791719.692782:0:14363:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788791719.692883:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+24:14502:x1875683606386944:12345-192.168.201.29@tcp:36:dd.0 Request processed in 529us (716us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788791719.692890:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 35 00000020:00080000:2.0:1788791719.692895:0:14363:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788791719.695924:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791719.696017:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606387072 00000100:00100000:1.0:1788791719.696028:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606387072 00000100:00100000:1.0:1788791719.696100:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 36 00000100:00100000:1.0:1788791719.696111:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+24:14502:x1875683606387072:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:1.0:1788791719.696172:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791719.696194:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a324298 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675492 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.696251:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a324298 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675492 expref: 25 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.696266:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a324298 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675492 expref: 25 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791719.696282:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:1.0:1788791719.696286:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788791719.696290:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92ca00, rc 0) 00000100:00100000:1.0:1788791719.696351:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc146300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+25:14502:x1875683606387072:12345-192.168.201.29@tcp:101:dd.0 Request processed in 241us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791719.696375:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 36 00010000:00010000:2.0:1788791719.701108:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a324291 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.701158:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a324291 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.701168:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a324291 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.701173:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ffa00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791719.701178:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a324291 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.701186:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a324291 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.701204:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791719.701207:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791719.701231:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a324291 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.701236:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a324291 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791719.718904:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791719.719073:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606387328 00000100:00100000:2.0:1788791719.719083:0:14347:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606387328 00000100:00100000:2.0:1788791719.719187:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:2.0:1788791719.719198:0:14347:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+24:14502:x1875683606387328:12345-192.168.201.29@tcp:103:dd.0 00010000:00010000:2.0:1788791719.719216:0:14347:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791719.719239:0:14347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92ca00/0xcd6380150a324298 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675492 expref: 24 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.719256:0:14347:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791719.719260:0:14347:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788791719.719971:0:14347:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+23:14502:x1875683606387328:12345-192.168.201.29@tcp:103:dd.0 Request processed in 131us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791719.719982:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:0.0:1788791719.723753:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791719.723873:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606387456 00000100:00100000:2.0:1788791719.723883:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606387456 00000100:00100000:2.0:1788791719.723944:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:2.0:1788791719.723954:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+23:14502:x1875683606387456:12345-192.168.201.29@tcp:58:dd.0 00010000:00010000:2.0:1788791719.724070:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a32429f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.724087:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a32429f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.724098:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a32429f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788791719.725228:0:14361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788791719.726431:0:14361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788791719.726604:0:14361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788791719.726804:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+23:14502:x1875683606387456:12345-192.168.201.29@tcp:58:dd.0 Request processed in 2847us (3066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791719.726817:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 37 00000100:00100000:3.0:1788791719.732737:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791719.732810:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606387584 00000100:00100000:2.0:1788791719.732821:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606387584 00000100:00100000:2.0:1788791719.732882:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 38 00000100:00100000:2.0:1788791719.732892:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+23:14502:x1875683606387584:12345-192.168.201.29@tcp:101:dd.0 00010000:00010000:2.0:1788791719.732912:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791719.732934:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3242a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a9453675499 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.732993:0:14363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a32429f lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.733004:0:14363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3242a6 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675499 expref: 24 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.733024:0:14363:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a32429f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.733037:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3242a6 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675499 expref: 24 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.733050:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791719.733077:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788791719.733082:0:14363:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3242a6 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675499 expref: 24 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791719.733091:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fe400, rc 0) 00000100:00100000:2.0:1788791719.733368:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+24:14502:x1875683606387584:12345-192.168.201.29@tcp:101:dd.0 Request processed in 477us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791719.733376:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 38 00010000:00010000:0.0:1788791720.036284:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788791720.227541:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788791720.227565:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9abab7985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630488192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788791720.227635:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791720.227780:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630488192 00000100:00100000:1.0:1788791720.227789:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630488192 00000100:00100000:1.0:1788791720.227855:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788791720.227867:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630488192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788791720.227902:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788791720.227952:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875683630488192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791720.227960:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788791720.228004:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9abab7985180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875683630488192:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788791720.228075:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788791720.315633:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:1.0:1788791720.315658:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1788791720.315672:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000040:00080000:0.0:1788791720.547410:0:14393:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788791720.547420:0:14393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788791720.547484:0:14393:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788791720.547491:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788791720.547626:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababc144380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14393:1875683630488320:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788791720.547725:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba856b0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788791720.555252:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababc144380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14393:1875683630488320:192.168.201.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788791720.558485:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791720.558642:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606387712 00000100:00100000:2.0:1788791720.558653:0:14372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606387712 00000100:00100000:2.0:1788791720.558711:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1788791720.558722:0:14372:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6788f146-04ff-4ba5-8299-9481a02c8bed+11:14504:x1875683606387712:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788791720.558833:0:14372:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6788f146-04ff-4ba5-8299-9481a02c8bed+11:14504:x1875683606387712:12345-192.168.201.29@tcp:900:lhsmtool_posix.0 Request processed in 112us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791720.558841:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:1.0:1788791720.571764:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791720.574106:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606387840 00000100:00100000:2.0:1788791720.574123:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606387840 00000100:00100000:2.0:1788791720.574232:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:2.0:1788791720.574244:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+11:14504:x1875683606387840:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788791720.574280:0:14361:0:(mdt_handler.c:8010:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788791720.574684:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7985180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+11:14504:x1875683606387840:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 441us (2928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791720.574692:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 39 00000100:00100000:3.0:1788791720.592709:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791720.592966:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606387968 00000100:00100000:2.0:1788791720.592977:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606387968 00000100:00100000:2.0:1788791720.593044:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:2.0:1788791720.593055:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+11:14504:x1875683606387968:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788791720.593180:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3242ad lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593197:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3242ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593209:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3242ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593269:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a3242b4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593277:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a3242b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593283:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a3242b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593308:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3242bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593316:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3242bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593322:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3242bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791720.593489:0:14363:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788791720.593494:0:14363:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788791720.593509:0:14363:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3242bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593520:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3242ad lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593533:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3242ad lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593540:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3242ad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593545:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791720.593550:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3242ad lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593556:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3242ad lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593580:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9aba8533f400) 00010000:00010000:2.0:1788791720.593583:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791720.593587:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3242ad lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593592:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a3242ad lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593606:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a3242b4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593612:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a3242b4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593617:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a3242b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593621:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791720.593630:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a3242b4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593636:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a3242b4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593644:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9aba8533fa00) 00010000:00010000:2.0:1788791720.593646:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791720.593649:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a3242b4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593655:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a3242b4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593668:0:14363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3242bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593674:0:14363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3242bb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593679:0:14363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3242bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593684:0:14363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791720.593687:0:14363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3242bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593693:0:14363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3242bb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593699:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791720.593702:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791720.593711:0:14363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3242bb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.593717:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a3242bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791720.593815:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+11:14504:x1875683606387968:12345-192.168.201.29@tcp:34:lhsmtool_posix.0 Request processed in 760us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791720.593824:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 40 00000100:00100000:0.0:1788791720.598663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791720.598716:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606388224 00000100:00100000:2.0:1788791720.598739:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606388224 00000100:00100000:2.0:1788791720.598815:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:2.0:1788791720.598827:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+11:14504:x1875683606388224:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788791720.598854:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791720.598876:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3242c2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536754a0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.598979:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3242c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.598996:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3242c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.599008:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3242c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788791720.599020:0:14361:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788791720.599207:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3242c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.599216:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3242c9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.599234:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3242c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.599241:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791720.599246:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3242c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.599254:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3242c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.599267:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791720.599271:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788791720.599281:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3242c9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.599288:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a3242c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.599333:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3242c2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754a0 expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.599932:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9aba8533f400) 00010000:00010000:2.0:1788791720.599935:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788791720.599940:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a3242c2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754a0 expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.599952:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994fec00, rc 0) 00000100:00100000:2.0:1788791720.600082:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+12:14504:x1875683606388224:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 1256us (1430us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788791720.600100:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 41 00000100:00100000:1.0:1788791720.624595:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791720.624740:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606388352 00000100:00100000:2.0:1788791720.624751:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606388352 00000100:00100000:2.0:1788791720.624833:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:2.0:1788791720.624843:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+12:14504:x1875683606388352:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788791720.624899:0:14362:0:(mdt_handler.c:8010:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788791720.625007:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+12:14504:x1875683606388352:12345-192.168.201.29@tcp:53:lhsmtool_posix.0 Request processed in 165us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791720.625015:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 42 00000100:00100000:0.0:1788791720.630878:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791720.630975:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606388608 00000100:00100000:3.0:1788791720.630985:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606388608 00000100:00100000:3.0:1788791720.631047:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:3.0:1788791720.631058:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+12:14504:x1875683606388608:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788791720.631078:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791720.631100:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3242d7 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536754a7 expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788791720.633680:0:14363:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1788791720.633695:0:14363:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1788791720.633763:0:14363:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788791720.635290:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3242de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.635307:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3242de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.635320:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3242de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.638253:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d200/0xcd6380150a3242d7 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754a7 expref: 15 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.638285:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3242de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754a7 expref: 14 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.638317:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9aba8823cc00) 00010000:00010000:3.0:1788791720.638320:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788791720.638324:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16d600, rc 0) 00000100:00100000:3.0:1788791720.638401:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc144a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+14:14504:x1875683606388608:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 7343us (7534us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1788791720.638411:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 43 00000100:00100000:0.0:1788791720.642629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791720.643322:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606388864 00000100:00100000:3.0:1788791720.643334:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606388864 00000100:00100000:3.0:1788791720.643404:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:3.0:1788791720.643413:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+14:14504:x1875683606388864:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788791720.643473:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791720.643500:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d600/0xcd6380150a3242de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754a7 expref: 14 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.643533:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9aba8823cc00) 00010000:00010000:3.0:1788791720.643543:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788791720.643564:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a3242ec lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.643577:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a3242ec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.643585:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a3242ec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.643645:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3242f3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x58e3de48 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.643671:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3242f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x58e3de48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.643678:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3242f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x58e3de48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.643970:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a3242ec lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.643980:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a3242ec lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.643986:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a3242ec lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.643993:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16cc00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791720.643997:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a3242ec lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.644004:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a3242ec lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.644014:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9aba8533fb00) 00010000:00010000:3.0:1788791720.644017:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791720.644021:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a3242ec lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.644027:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16cc00/0xcd6380150a3242ec lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.644037:0:14361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3242f3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x58e3de48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.644463:0:14361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3242f3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x58e3de48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.644469:0:14361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3242f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x58e3de48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.644474:0:14361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791720.644477:0:14361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3242f3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x58e3de48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.644483:0:14361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3242f3 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x58e3de48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.644492:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x58e3de48 (ffff9aba8823cf00) 00010000:00010000:3.0:1788791720.644498:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791720.644500:0:14361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3242f3 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x58e3de48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.644563:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16d400/0xcd6380150a3242f3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x58e3de48 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791720.644668:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+13:14504:x1875683606388864:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 1253us (2048us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788791720.644676:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 44 00000100:00100000:1.0:1788791720.646838:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791720.646917:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606388992 00000100:00100000:3.0:1788791720.646930:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606388992 00000100:00100000:3.0:1788791720.646987:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:3.0:1788791720.646996:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+13:14504:x1875683606388992:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788791720.647017:0:14363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788791720.647064:0:14363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16dc00/0xcd6380150a3242fa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536754ae expref: -99 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.647100:0:14363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ca00/0xcd6380150a324301 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.647112:0:14363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ca00/0xcd6380150a324301 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.647122:0:14363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ca00/0xcd6380150a324301 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14363 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.647253:0:14363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16dc00/0xcd6380150a3242fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754ae expref: 15 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.647273:0:14363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16ca00/0xcd6380150a324301 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754ae expref: 14 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.647282:0:14363:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:3.0:1788791720.647285:0:14363:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788791720.647288:0:14363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb16ca00, rc 0) 00000100:00100000:3.0:1788791720.647353:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7986d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+14:14504:x1875683606388992:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 358us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791720.647360:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 45 00000100:00100000:0.0:1788791720.649743:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791720.649836:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606389248 00000100:00100000:2.0:1788791720.649846:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606389248 00000100:00100000:2.0:1788791720.649898:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 46 00000100:00100000:2.0:1788791720.649907:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+14:14504:x1875683606389248:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788791720.649982:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324308 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.649997:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324308 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.650008:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324308 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788791720.650515:0:14362:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788791720.650528:0:14362:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 497030400079ns, next at 498030397486ns, rc = 0 00000004:00010000:2.0:1788791720.650615:0:14362:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000b190a221 reply state 00000000b232d944 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324308 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791720.650637:0:14362:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788791720.650838:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+16:14504:x1875683606389248:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 930us (1112us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788791720.650846:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 46 00010000:00010000:0.0:1788791720.658394:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324308 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791720.658410:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324308 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791720.658416:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324308 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791720.658422:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fec00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:0.0:1788791720.658426:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324308 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791720.658433:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324308 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791720.658450:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:0.0:1788791720.658453:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788791720.658457:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324308 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791720.658480:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fec00/0xcd6380150a324308 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791720.659364:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791720.659494:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606389376 00000100:00100000:2.0:1788791720.659505:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606389376 00000100:00100000:2.0:1788791720.659556:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:2.0:1788791720.659566:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+15:14504:x1875683606389376:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788791720.659590:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788791720.659610:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32430f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536754b5 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.659667:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32430f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754b5 expref: 16 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.659681:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32430f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754b5 expref: 16 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.659700:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:2.0:1788791720.659703:0:14361:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788791720.659706:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba994ff000, rc 0) 00000100:00100000:2.0:1788791720.659781:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc146680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+16:14504:x1875683606389376:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 215us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791720.659787:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 47 00000100:00100000:1.0:1788791720.663835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791720.663885:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606389504 00000100:00100000:2.0:1788791720.663896:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606389504 00000100:00100000:2.0:1788791720.663983:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:2.0:1788791720.663994:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2355:x1875683606389504:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788791720.664035:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788791720.664489:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+6:2355:x1875683606389504:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 496us (663us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788791720.664498:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 12 00000100:00100000:3.0:1788791720.666779:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791720.667193:0:14365:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606389760 00000100:00100000:2.0:1788791720.667204:0:14365:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606389760 00000100:00100000:2.0:1788791720.667258:0:14365:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:2.0:1788791720.667269:0:14365:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+16:14504:x1875683606389760:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788791720.667577:0:14365:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+17:14504:x1875683606389760:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 309us (805us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788791720.667587:0:14365:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 9 00000100:00100000:0.0:1788791720.671642:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791720.671771:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606390016 00000100:00100000:3.0:1788791720.671782:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606390016 00000100:00100000:3.0:1788791720.671846:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:3.0:1788791720.671856:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+17:14504:x1875683606390016:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788791720.671987:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+17:14504:x1875683606390016:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 132us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791720.671994:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 48 00000100:00100000:0.0:1788791720.676839:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791720.676937:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606390144 00000100:00100000:1.0:1788791720.676947:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606390144 00000100:00100000:1.0:1788791720.677006:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:1.0:1788791720.677018:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+17:14504:x1875683606390144:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788791720.677038:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788791720.677059:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92da00/0xcd6380150a324316 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536754bc expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791720.677185:0:14362:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a32431d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791720.677208:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a32431d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791720.677219:0:14362:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a32431d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788791720.677260:0:14362:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788791720.677278:0:14362:0:(mdt_handler.c:2542:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a32431d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14362 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791720.677319:0:14362:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92da00/0xcd6380150a324316 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754bc expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791720.677337:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a32431d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754bc expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791720.677346:0:14362:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:1.0:1788791720.677349:0:14362:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788791720.677352:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9ababb92c800, rc 0) 00000100:00100000:1.0:1788791720.677404:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+18:14504:x1875683606390144:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 389us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791720.677412:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 49 00000100:00100000:1.0:1788791720.682345:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791720.682474:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606390272 00000100:00100000:0.0:1788791720.682484:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606390272 00000100:00100000:0.0:1788791720.682543:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1788791720.682554:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+6:2354:x1875683606390272:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788791720.682572:0:15043:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788791720.682594:0:15043:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015a4f3d6/0xcd6380150a324324 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcf751a94536754c3 expref: -99 pid: 15043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788791720.682621:0:15043:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ecba8, blocks: 0x1 00010000:00010000:0.0:1788791720.682642:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=497s v=(0 0) 00010000:00010000:0.0:1788791720.682646:0:15043:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791720.682655:0:15043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015a4f3d6/0xcd6380150a324324 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754c3 expref: 7 pid: 15043 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791720.682672:0:15043:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000015a4f3d6/0xcd6380150a324324 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754c3 expref: 7 pid: 15043 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791720.682684:0:15043:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9aba851cbc00, rc 0) 00000100:00100000:0.0:1788791720.682753:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7984e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+7:2354:x1875683606390272:12345-192.168.201.29@tcp:101:lhsmtool_posix.0 Request processed in 200us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788791720.682775:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:0.0:1788791720.686739:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791720.686834:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606390528 00000100:00100000:2.0:1788791720.686842:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606390528 00000100:00100000:2.0:1788791720.686891:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:2.0:1788791720.686899:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+18:14504:x1875683606390528:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788791720.686994:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+18:14504:x1875683606390528:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 96us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791720.686999:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 50 00000100:00100000:1.0:1788791720.694052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791720.694181:0:14363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606390656 00000100:00100000:3.0:1788791720.694193:0:14363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606390656 00000100:00100000:3.0:1788791720.694248:0:14363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:3.0:1788791720.694258:0:14363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+18:14504:x1875683606390656:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788791720.744643:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630488448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791720.744716:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791720.744830:0:15047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630488448 00000100:00100000:3.0:1788791720.744838:0:15047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630488448 00000100:00100000:3.0:1788791720.744891:0:15047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788791720.744899:0:15047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630488448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788791720.744932:0:15047:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788791720.744978:0:15047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875683630488448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791720.744986:0:15047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788791720.745201:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788791720.745237:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875683630488448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788791720.746715:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa113159-ee5b-4f24-93ba-c8c094c83d87:3315:1875683630488576:0@lo:400:kworker.0 00000100:00100000:3.0:1788791720.746786:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791720.746840:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788791720.746848:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630488704:0@lo:400:kworker.0 00000100:00100000:3.0:1788791720.746877:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788791720.746919:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630488704 00000100:00100000:3.0:1788791720.746926:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630488704 00000100:00100000:3.0:1788791720.746968:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788791720.746977:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630488704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788791720.747027:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630488704:12345-0@lo:400:kworker.0 Request processed in 51us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791720.747034:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788791720.747091:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630488704:0@lo:400:kworker.0 00000100:00100000:1.0:1788791720.748722:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630488576 00000100:00100000:1.0:1788791720.748745:0:14354:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630488576 00000100:00100000:1.0:1788791720.748792:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788791720.748801:0:14354:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7a00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3315:x1875683630488576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788791720.748890:0:14354:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7a00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa113159-ee5b-4f24-93ba-c8c094c83d87+19:3315:x1875683630488576:12345-0@lo:400:kworker.0 Request processed in 90us (2103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791720.748898:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788791720.749034:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb485f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:aa113159-ee5b-4f24-93ba-c8c094c83d87:3315:1875683630488576:0@lo:400:kworker.0 00000100:00100000:2.0:1788791720.752384:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788791720.752405:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630488832:0@lo:400:kworker.0 00000100:00100000:2.0:1788791720.752470:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791720.756749:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630488960:0@lo:400:kworker.0 00000100:00100000:2.0:1788791720.756824:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791720.756866:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788791720.756887:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630489088:0@lo:400:kworker.0 00000100:00100000:2.0:1788791720.756912:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791720.756943:0:14362:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788791720.756951:0:14362:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788791720.758023:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788791720.760170:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630488832 00000100:00100000:2.0:1788791720.760189:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630488832 00000100:00100000:2.0:1788791720.760250:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788791720.760261:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630488960 00000100:00100000:2.0:1788791720.760263:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630488960 00000100:00100000:2.0:1788791720.760648:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788791720.760656:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630489088 00000100:00100000:2.0:1788791720.760659:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630489088 00000100:00100000:2.0:1788791720.760674:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788791720.760684:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788791720.760693:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630488832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791720.760824:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb485180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875683630488832:12345-0@lo:400:kworker.0 Request processed in 130us (8351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791720.760831:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788791720.760848:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788791720.760854:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788791720.760859:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630488960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791720.760895:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb487b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875683630488960:12345-0@lo:400:kworker.0 Request processed in 36us (4071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791720.760900:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788791720.760910:0:14361:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788791720.760915:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788791720.760921:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630489088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788791720.760947:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb487100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875683630489088:12345-0@lo:400:kworker.0 Request processed in 26us (4034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791720.760968:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788791720.760988:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788791720.762091:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb487480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875683630488832:0@lo:400:kworker.0 00000100:00100000:2.0:1788791720.762481:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb484380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875683630489088:0@lo:400:kworker.0 00000100:00100000:2.0:1788791720.762500:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875683630488960:0@lo:400:kworker.0 00000001:00080000:1.0:1788791720.788689:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1788791720.788710:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788791720.788913:0:14363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7987800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+14:14504:x1875683606390656:12345-192.168.201.29@tcp:44:lhsmtool_posix.0 Request processed in 94648us (94874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788791720.788926:0:14363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 51 00000100:00100000:1.0:1788791720.789308:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788791720.789324:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9aba85780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630489216:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788791720.789526:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788791720.789664:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630489216 00000100:00100000:1.0:1788791720.789674:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630489216 00000100:00100000:1.0:1788791720.789737:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788791720.789749:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875683630489216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788791720.790010:0:15043:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788791720.790014:0:15043:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788791720.790016:0:15043:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788791720.790859:0:15043:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788791720 -> 1788791720 00002000:00010000:1.0:1788791720.790863:0:15043:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788791720.790938:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875683630489216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1189us (1413us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788791720.790947:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1788791720.791966:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9aba85780e00/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788791720.791977:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9aba85780e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875683630489216:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788791720.794302:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791720.795125:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606390784 00000100:00100000:0.0:1788791720.795259:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606390784 00000100:00100000:1.0:1788791720.795586:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:1.0:1788791720.795600:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+7:2353:x1875683606390784:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788791720.795775:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+7:2353:x1875683606390784:12345-192.168.201.29@tcp:16:lhsmtool_posix.0 Request processed in 176us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791720.795800:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:0.0:1788791720.800896:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791720.801000:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606391040 00000100:00100000:2.0:1788791720.801010:0:14361:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606391040 00000100:00100000:2.0:1788791720.801191:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 52 00000100:00100000:2.0:1788791720.801201:0:14361:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+14:14504:x1875683606391040:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788791720.801424:0:14361:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788791720.801453:0:14361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb92c800/0xcd6380150a32431d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754bc expref: 14 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.801470:0:14361:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:2.0:1788791720.801475:0:14361:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788791720.801504:0:14361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32432b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.801518:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32432b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.801527:0:14361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32432b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788791720.801749:0:14361:0:(mdt_handler.c:4524:mdt_save_lock()) ### save lock request 00000000a7b8ac4f reply state 00000000022aa2d1 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32432b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791720.801759:0:14361:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788791720.801861:0:14361:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+15:14504:x1875683606391040:12345-192.168.201.29@tcp:36:lhsmtool_posix.0 Request processed in 661us (977us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788791720.801867:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 52 00010000:00010000:3.0:1788791720.804168:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32432b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.804184:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32432b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.804191:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32432b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.804198:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff200 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:3.0:1788791720.804203:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32432b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.804210:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32432b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.804226:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:3.0:1788791720.804229:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788791720.804234:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32432b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.804241:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff200/0xcd6380150a32432b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791720.805431:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791720.806635:0:16235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606391168 00000100:00100000:2.0:1788791720.806649:0:16235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606391168 00000100:00100000:2.0:1788791720.806713:0:16235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:2.0:1788791720.806734:0:16235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6788f146-04ff-4ba5-8299-9481a02c8bed+7:2354:x1875683606391168:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788791720.806938:0:16235:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788791720.806942:0:16235:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788791719 00002000:00010000:2.0:1788791720.806944:0:16235:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788791719 00002000:00010000:2.0:1788791720.806947:0:16235:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788791720 -> 1788791719 00002000:00010000:2.0:1788791720.806949:0:16235:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788791720.807233:0:16235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85780700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6788f146-04ff-4ba5-8299-9481a02c8bed+8:2354:x1875683606391168:12345-192.168.201.29@tcp:2:lhsmtool_posix.0 Request processed in 509us (1808us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788791720.807241:0:16235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:1.0:1788791720.813672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791720.813838:0:15045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606391296 00000100:00100000:3.0:1788791720.813848:0:15045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606391296 00000100:00100000:3.0:1788791720.813910:0:15045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:3.0:1788791720.813921:0:15045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+8:2355:x1875683606391296:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788791720.813969:0:15045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a324332 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.813986:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791720.813991:0:15045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791720.813997:0:15045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a324332 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.814011:0:15045:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a324332 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.814052:0:15045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a324332 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.814061:0:15045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a324332 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.814070:0:15045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a324332 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.814077:0:15045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16dc00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791720.814092:0:15045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a324332 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.814101:0:15045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a324332 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.814116:0:15045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a324332 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.814146:0:15045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079e39306/0xcd6380150a324332 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15045 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791720.814229:0:15045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+8:2355:x1875683606391296:12345-192.168.201.29@tcp:1:lhsmtool_posix.0 Request processed in 306us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791720.814236:0:15045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:0.0:1788791720.816869:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791720.816965:0:16588:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606391552 00000100:00100000:2.0:1788791720.816976:0:16588:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606391552 00000100:00100000:2.0:1788791720.817037:0:16588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 53 00000100:00100000:2.0:1788791720.817056:0:16588:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6788f146-04ff-4ba5-8299-9481a02c8bed+14:14504:x1875683606391552:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788791720.817169:0:16588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a324339 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.817204:0:16588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a324339 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.817216:0:16588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a324339 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.817458:0:16588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a324340 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.817470:0:16588:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32430f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754b5 expref: 15 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.817478:0:16588:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a324340 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.817514:0:16588:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32430f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536754b5 expref: 15 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.817529:0:16588:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32430f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536754b5 expref: 15 pid: 14361 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791720.817545:0:16588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16588:1875683630489344:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788791720.817692:0:16588:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ab9811f1540 going to sleep for 11 seconds 00000100:00100000:2.0:1788791720.826497:0:16588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16588:1875683630489344:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791720.826539:0:16588:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a324340 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788791720.828387:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791720.828478:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606391680 00000100:00100000:3.0:1788791720.828488:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606391680 00010000:00010000:3.0:1788791720.828544:0:14346:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32430f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536754b5 expref: 16 pid: 14361 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791720.828596:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 13 00000100:00100000:3.0:1788791720.828607:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+16:2354:x1875683606391680:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788791720.828622:0:14346:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788791720.828629:0:14346:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32430f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536754b5 expref: 16 pid: 14361 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.828642:0:14346:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32430f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536754b5 expref: 16 pid: 14361 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.828681:0:14346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff000/0xcd6380150a32430f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536754b5 expref: 16 pid: 14361 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.828698:0:14346:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:3.0:1788791720.828704:0:14346:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a324340 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.828713:0:14346:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a324340 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.828720:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a324340 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.828767:0:14346:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788791720.828831:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+15:2354:x1875683606391680:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 225us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791720.828838:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 13 00010000:00010000:0.0:1788791720.829073:0:16588:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a324340 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791720.829082:0:16588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a324340 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788791720.829321:0:16588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1788791720.829471:0:16588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1788791720.829535:0:16588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1788791720.829897:0:16588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababbfda680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16588:1875683630489472:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788791720.829993:0:16588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788791720.830026:0:16588:0:(client.c:2715:ptlrpc_set_wait()) set ffff9aba991b3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788791720.832065:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630489472 00000100:00100000:3.0:1788791720.832080:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630489472 00000100:00100000:3.0:1788791720.832165:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788791720.832176:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16588:x1875683630489472:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788791720.832312:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16588:x1875683630489472:12345-0@lo:1000:mdt00_003.0 Request processed in 137us (2316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791720.832321:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788791720.832473:0:16588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababbfda680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16588:1875683630489472:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788791720.833269:0:16588:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788791720.833353:0:16588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16588:1875683630489600:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788791720.833403:0:16588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788791720.833429:0:16588:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ab9811f1600 going to sleep for 11 seconds 00000100:00100000:3.0:1788791720.833880:0:14366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683630489600 00000100:00100000:3.0:1788791720.833888:0:14366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683630489600 00000100:00100000:3.0:1788791720.833929:0:14366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788791720.833941:0:14366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:16588:x1875683630489600:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788791720.834189:0:14366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb484380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:16588:x1875683630489600:12345-0@lo:1000:mdt00_003.0 Request processed in 251us (785us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788791720.834197:0:14366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788791720.834450:0:16588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:16588:1875683630489600:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788791720.834486:0:16588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a324340 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.834496:0:16588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a324340 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.834509:0:16588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a324340 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.834515:0:16588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff600 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791720.834523:0:16588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a324340 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.834530:0:16588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a324340 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.834549:0:16588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:2.0:1788791720.834552:0:16588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788791720.834556:0:16588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a324340 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.834563:0:16588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff600/0xcd6380150a324340 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.834596:0:16588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a32429f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.834612:0:16588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a32429f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.834618:0:16588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a32429f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.834623:0:16588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ffa00 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791720.834627:0:16588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a32429f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.834633:0:16588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a32429f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.834641:0:16588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791720.834644:0:16588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788791720.834655:0:16588:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3242a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675499 expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.834667:0:16588:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3242a6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675499 expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.834679:0:16588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3242a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675499 expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.834713:0:16588:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe400/0xcd6380150a3242a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a9453675499 expref: 18 pid: 14363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791720.834733:0:16588:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16588:1875683630489728:192.168.201.29@tcp:105: 00000100:00100000:2.0:1788791720.834816:0:16588:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ab9811f1600 going to sleep for 11 seconds 00000100:00100000:0.0:1788791720.838971:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791720.839044:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606391808 00000100:00100000:3.0:1788791720.839053:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606391808 00000100:00100000:3.0:1788791720.839108:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:3.0:1788791720.839117:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba86790c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+19:14502:x1875683606391808:12345-192.168.201.29@tcp:49:dd.0 00000100:00100000:3.0:1788791720.839269:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba86790c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+19:14502:x1875683606391808:12345-192.168.201.29@tcp:49:dd.0 Request processed in 152us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791720.839275:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 10 00000100:00100000:2.0:1788791720.839412:0:16588:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16588:1875683630489728:192.168.201.29@tcp:105: 00010000:00010000:2.0:1788791720.839439:0:16588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a32429f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839450:0:16588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ffa00/0xcd6380150a32429f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14361 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839482:0:16588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a324347 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839497:0:16588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a324347 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839507:0:16588:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a324347 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839516:0:16588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a324347 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839522:0:16588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a324347 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839528:0:16588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a324347 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839534:0:16588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe000 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791720.839537:0:16588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a324347 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839544:0:16588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a324347 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839575:0:16588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791720.839578:0:16588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788791720.839582:0:16588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a324347 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839588:0:16588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994fe000/0xcd6380150a324347 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839598:0:16588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a324339 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839605:0:16588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a324339 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839611:0:16588:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a324339 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839616:0:16588:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff400 already unused, calling callback (ffffffffc21d44f0) 00010000:00010000:2.0:1788791720.839619:0:16588:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a324339 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839625:0:16588:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a324339 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839632:0:16588:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9aba8533fe00) 00010000:00010000:2.0:1788791720.839635:0:16588:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788791720.839637:0:16588:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a324339 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.839643:0:16588:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9aba994ff400/0xcd6380150a324339 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16588 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788791720.839946:0:14393:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788791720.839950:0:14393:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788791720.839972:0:14393:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788791720.839977:0:14393:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788791720.840057:0:16588:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6788f146-04ff-4ba5-8299-9481a02c8bed+18:14504:x1875683606391552:12345-192.168.201.29@tcp:57:lhsmtool_posix.0 Request processed in 23002us (23197us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788791720.840066:0:16588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 53 00000020:00080000:2.0:1788791720.840070:0:16588:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788791720.846670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791720.846768:0:14364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606392064 00000100:00100000:3.0:1788791720.846780:0:14364:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606392064 00000100:00100000:3.0:1788791720.846838:0:14364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 11 00000100:00100000:3.0:1788791720.846848:0:14364:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababbfd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+18:14504:x1875683606392064:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788791720.847672:0:14364:0:(mdd_object.c:4131:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788791720.847803:0:14364:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1788791720.847852:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16dc00/0xcd6380150a32434e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.847870:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16dc00/0xcd6380150a32434e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.847883:0:14364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16dc00/0xcd6380150a32434e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.847892:0:14364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16dc00/0xcd6380150a32434e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.847910:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16dc00/0xcd6380150a32434e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.847916:0:14364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16dc00/0xcd6380150a32434e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791720.847948:0:14364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788791720.849278:0:14349:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788791720.849289:0:14349:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16dc00/0xcd6380150a32434e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.849299:0:14349:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16dc00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791720.849304:0:14349:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16dc00/0xcd6380150a32434e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.849312:0:14349:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16dc00/0xcd6380150a32434e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.849327:0:14349:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9aba8823ca00) 00010000:00010000:2.0:1788791720.849330:0:14349:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788791720.849336:0:14349:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16dc00/0xcd6380150a32434e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.849341:0:14349:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9ababb16dc00/0xcd6380150a32434e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14364 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791720.849359:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791720.849361:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791720.849376:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788791720.851556:0:14364:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababbfd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+20:14504:x1875683606392064:12345-192.168.201.29@tcp:35:lhsmtool_posix.0 Request processed in 4695us (4885us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788791720.851571:0:14364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 11 00000020:00080000:3.0:1788791720.851579:0:14364:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788791721.040235:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791721.040276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791721.040324:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:2.0:1788791721.040539:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606392192 00000100:00100000:2.0:1788791721.040550:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606392192 00000100:00100000:2.0:1788791721.040609:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606392320 00000100:00100000:2.0:1788791721.040613:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606392320 00000100:00100000:2.0:1788791721.040627:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606392448 00000100:00100000:2.0:1788791721.040630:0:15051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606392448 00000100:00100000:2.0:1788791721.040648:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:2.0:1788791721.040657:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+10:2354:x1875683606392192:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:2.0:1788791721.040690:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a324355 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.040708:0:15051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000015a4f3d6/0xcd6380150a324324 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.29@tcp remote: 0xcf751a94536754c3 expref: 10 pid: 15043 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.040717:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791721.040734:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791721.040740:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a324355 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.040778:0:15051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000015a4f3d6/0xcd6380150a324324 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536754c3 expref: 10 pid: 15043 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.040791:0:15051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000015a4f3d6/0xcd6380150a324324 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536754c3 expref: 10 pid: 15043 timeout: 597 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791721.040805:0:15051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ababb486300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:15051:1875683630489856:192.168.201.29@tcp:104: 00000100:00100000:2.0:1788791721.040902:0:15051:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ab9811f1600 going to sleep for 11 seconds 00000100:00100000:1.0:1788791721.050694:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:0.0:1788791721.050817:0:15050:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788791721.050828:0:15050:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788791721.051393:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606392576 00000100:00100000:1.0:1788791721.051404:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606392576 00000100:00100000:0.0:1788791721.053112:0:16589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:0.0:1788791721.053182:0:16589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6788f146-04ff-4ba5-8299-9481a02c8bed+11:2355:x1875683606392320:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:0.0:1788791721.053224:0:16589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a32435c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791721.053249:0:16589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791721.053254:0:16589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788791721.053259:0:16589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a32435c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791721.053269:0:16589:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a32435c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791721.056327:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791721.056380:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791721.056407:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791721.056456:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791721.056491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:1.0:1788791721.056534:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606393216 00000100:00100000:1.0:1788791721.056543:0:14348:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606393216 00010000:00010000:1.0:1788791721.056591:0:14348:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000015a4f3d6/0xcd6380150a324324 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536754c3 expref: 12 pid: 15043 timeout: 597 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791721.056630:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:1.0:1788791721.056641:0:14348:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+12:2353:x1875683606393216:12345-192.168.201.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788791721.056658:0:14348:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788791721.056684:0:14348:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000015a4f3d6/0xcd6380150a324324 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536754c3 expref: 12 pid: 15043 timeout: 597 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.056698:0:14348:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000015a4f3d6/0xcd6380150a324324 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536754c3 expref: 12 pid: 15043 timeout: 597 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.056765:0:14348:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791721.056769:0:14348:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791721.056774:0:14348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a324355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.056784:0:14348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a324355 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.056794:0:14348:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791721.056797:0:14348:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788791721.056801:0:14348:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a32435c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.056808:0:14348:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a32435c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.056831:0:14348:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788791721.056884:0:14348:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+12:2353:x1875683606393216:12345-192.168.201.29@tcp:103:ldlm_bl.0 Request processed in 244us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788791721.056892:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 14 00000100:00100000:0.0:1788791721.057293:0:15050:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788791721.057302:0:15050:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00010000:00010000:0.0:1788791721.057325:0:16589:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a32435c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788791721.057335:0:16589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a32435c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.058804:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015a4f3d6/0xcd6380150a324324 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.29@tcp remote: 0xcf751a94536754c3 expref: 11 pid: 15043 timeout: 597 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791721.058827:0:15051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ababb486300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_002:lustre-OST0000_UUID:15051:1875683630489856:192.168.201.29@tcp:104: 00010000:00010000:2.0:1788791721.058853:0:15051:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a324355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.058864:0:15051:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a324355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.058872:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a324355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.060751:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788791721.060788:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606392704 00000100:00100000:2.0:1788791721.060802:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606392704 00000100:00100000:2.0:1788791721.060856:0:15050:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788791721.060864:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606392832 00000100:00100000:2.0:1788791721.060867:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606392832 00000100:00100000:2.0:1788791721.060877:0:15050:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788791721.060882:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606392960 00000100:00100000:2.0:1788791721.060884:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606392960 00000100:00100000:2.0:1788791721.060894:0:15050:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788791721.060898:0:15050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606393088 00000100:00100000:2.0:1788791721.060900:0:15050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606393088 00000100:00100000:2.0:1788791721.061303:0:16590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:2.0:1788791721.061316:0:16590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6788f146-04ff-4ba5-8299-9481a02c8bed+16:2354:x1875683606392448:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:2.0:1788791721.061361:0:16590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a324363 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.061387:0:16590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791721.061391:0:16590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791721.061399:0:16590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a324363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.061412:0:16590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a324363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788791721.171570:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:1.0:1788791721.171592:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:1.0:1788791721.171605:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000001:00080000:1.0:1788791721.171615:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:3.0:1788791721.171742:0:15051:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:3.0:1788791721.171747:0:15051:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788791719 -> 1788791721 00002000:00010000:3.0:1788791721.171749:0:15051:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788791719 -> 1788791721 00002000:00010000:3.0:1788791721.171752:0:15051:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:3.0:1788791721.171766:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a324355 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.171779:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a324355 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.171788:0:15051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a324355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.171795:0:15051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791721.171801:0:15051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a324355 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.171827:0:15051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a324355 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.171848:0:15051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a324355 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.171855:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c48e4d3/0xcd6380150a324355 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791721.171950:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+14:2354:x1875683606392192:12345-192.168.201.29@tcp:4:dd.0 Request processed in 131288us (131720us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788791721.171964:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 0 00000100:00100000:3.0:1788791721.171999:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:3.0:1788791721.172011:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+13:2354:x1875683606392576:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:3.0:1788791721.172115:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044f52d5b/0xcd6380150a32436a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.172414:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791721.172421:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791721.172428:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044f52d5b/0xcd6380150a32436a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.172442:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044f52d5b/0xcd6380150a32436a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.174247:0:16590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a324363 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.174266:0:16590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a324363 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.174274:0:16590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a324363 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.174280:0:16590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791721.174285:0:16590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a324363 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.174303:0:16590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a324363 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.174326:0:16590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a324363 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.174334:0:16590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f03f07c/0xcd6380150a324363 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791721.174425:0:16590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6788f146-04ff-4ba5-8299-9481a02c8bed+12:2354:x1875683606392448:12345-192.168.201.29@tcp:4:dd.0 Request processed in 113107us (134096us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788791721.174434:0:16590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 2 00000100:00100000:3.0:1788791721.174475:0:16590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 4 00000100:00100000:3.0:1788791721.174488:0:16590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6788f146-04ff-4ba5-8299-9481a02c8bed+11:2354:x1875683606392704:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:3.0:1788791721.174516:0:16590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324371 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.174528:0:16590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791721.174532:0:16590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791721.174538:0:16590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324371 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.174549:0:16590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324371 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.175897:0:16589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a32435c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.175912:0:16589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a32435c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.175920:0:16589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a32435c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.175927:0:16589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba851ca000 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791721.175932:0:16589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a32435c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.175941:0:16589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a32435c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.175960:0:16589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a32435c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.175991:0:16589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a46dd328/0xcd6380150a32435c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791721.176075:0:16589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6788f146-04ff-4ba5-8299-9481a02c8bed+10:2355:x1875683606392320:12345-192.168.201.29@tcp:4:dd.0 Request processed in 122948us (135795us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788791721.176084:0:16589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 1 00000100:00100000:2.0:1788791721.176115:0:16589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:2.0:1788791721.176141:0:16589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6788f146-04ff-4ba5-8299-9481a02c8bed+9:2354:x1875683606392832:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:2.0:1788791721.176170:0:16589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a324378 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.176181:0:16589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791721.176185:0:16589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791721.176191:0:16589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a324378 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.176202:0:16589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a324378 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788791721.243546:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:3.0:1788791721.243636:0:16589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:3.0:1788791721.243642:0:16589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1788791721.243659:0:16589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a324378 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.243672:0:16589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a324378 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.243681:0:16589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a324378 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.243688:0:16589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994ff800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791721.243693:0:16589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a324378 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.243734:0:16589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a324378 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.243756:0:16589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a324378 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.243764:0:16589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069f28469/0xcd6380150a324378 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791721.243865:0:16589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6788f146-04ff-4ba5-8299-9481a02c8bed+15:2354:x1875683606392832:12345-192.168.201.29@tcp:4:dd.0 Request processed in 67737us (187487us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788791721.243875:0:16589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 5 00000100:00100000:3.0:1788791721.243906:0:16589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 6 00000100:00100000:3.0:1788791721.243918:0:16589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6788f146-04ff-4ba5-8299-9481a02c8bed+14:2354:x1875683606392960:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:3.0:1788791721.243949:0:16589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a32437f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.243960:0:16589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791721.243963:0:16589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788791721.243967:0:16589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a32437f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.243976:0:16589:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a32437f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788791721.293185:0:15051:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:2.0:1788791721.293195:0:15051:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:2.0:1788791721.293213:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044f52d5b/0xcd6380150a32436a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.293226:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044f52d5b/0xcd6380150a32436a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.293251:0:15051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044f52d5b/0xcd6380150a32436a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.293258:0:15051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16cc00 already unused, calling callback (ffffffffc1794230) 00010000:00010000:2.0:1788791721.293263:0:15051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044f52d5b/0xcd6380150a32436a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.293273:0:15051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044f52d5b/0xcd6380150a32436a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.293310:0:15051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044f52d5b/0xcd6380150a32436a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.293318:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044f52d5b/0xcd6380150a32436a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788791721.293432:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+16:2354:x1875683606392576:12345-192.168.201.29@tcp:4:dd.0 Request processed in 121417us (242742us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1788791721.293445:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 3 00000100:00100000:2.0:1788791721.293486:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 7 00000100:00100000:2.0:1788791721.293499:0:15051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab299f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+15:2354:x1875683606393088:12345-192.168.201.29@tcp:4:dd.0 00010000:00010000:2.0:1788791721.293539:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a324386 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.293552:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791721.293564:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788791721.293573:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a324386 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788791721.293586:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a324386 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.296449:0:16590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324371 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.296484:0:16590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324371 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.296493:0:16590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324371 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.296500:0:16590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d400 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791721.296505:0:16590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324371 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.296515:0:16590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324371 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.296535:0:16590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324371 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.296542:0:16590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bb2cc93/0xcd6380150a324371 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791721.296624:0:16590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6788f146-04ff-4ba5-8299-9481a02c8bed+15:2354:x1875683606392704:12345-192.168.201.29@tcp:4:dd.0 Request processed in 122137us (240305us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788791721.296636:0:16590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 4 00000001:00080000:1.0:1788791721.296671:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:1.0:1788791721.296683:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00000001:00080000:0.0:1788791721.341414:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:1.0:1788791721.343491:0:16589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1788791721.343524:0:16589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1788791721.343541:0:16589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a32437f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.343555:0:16589:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a32437f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.343564:0:16589:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a32437f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.343571:0:16589:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ababb16d600 already unused, calling callback (ffffffffc1794230) 00010000:00010000:1.0:1788791721.343576:0:16589:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a32437f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.343586:0:16589:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a32437f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.343608:0:16589:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a32437f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788791721.343617:0:16589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047eaebfe/0xcd6380150a32437f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788791721.343736:0:16589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6788f146-04ff-4ba5-8299-9481a02c8bed+9:2354:x1875683606392960:12345-192.168.201.29@tcp:4:dd.0 Request processed in 99815us (287322us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788791721.343746:0:16589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 6 00000001:00080000:1.0:1788791721.378684:0:6705:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:3.0:1788791721.378966:0:15051:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1788791721.378982:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a324386 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.378995:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a324386 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.379003:0:15051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a324386 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.379011:0:15051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9aba994fe800 already unused, calling callback (ffffffffc1794230) 00010000:00010000:3.0:1788791721.379015:0:15051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a324386 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.379021:0:15051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a324386 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.379044:0:15051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a324386 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788791721.379049:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5d5a85e/0xcd6380150a324386 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788791721.379444:0:15051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab299f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2354:x1875683606393088:12345-192.168.201.29@tcp:4:dd.0 Request processed in 85944us (322947us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788791721.379463:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 7 00010000:00010000:1.0:1788791722.083863:0:14350:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788791722.956925:0:16628:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1788791723.053218:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791723.053253:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791723.053292:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791723.053314:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791723.053334:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791723.053353:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791723.053374:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.29@tcp (source: 12345-192.168.201.29@tcp) 00000100:00100000:3.0:1788791723.053399:0:14356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606393344 00000100:00100000:3.0:1788791723.053409:0:14356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606393344 00000100:00100000:3.0:1788791723.053462:0:14356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:3.0:1788791723.053472:0:14356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9abab7a01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:2352:x1875683606393344:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791723.053550:0:14356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9abab7a01050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5a45585-bfa2-4f9a-ac32-a3df3c538c81+13:2352:x1875683606393344:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 80us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791723.053558:0:14356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 123 00000100:00100000:3.0:1788791723.053592:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606393600 00000100:00100000:3.0:1788791723.053596:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606393600 00000100:00100000:3.0:1788791723.053625:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606394112 00000100:00100000:3.0:1788791723.053628:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606394112 00000100:00100000:3.0:1788791723.053641:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606393728 00000100:00100000:3.0:1788791723.053644:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606393728 00000100:00100000:3.0:1788791723.053656:0:15043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606393984 00000100:00100000:3.0:1788791723.053659:0:15043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606393984 00000100:00100000:3.0:1788791723.053675:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:3.0:1788791723.053681:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2352:x1875683606393600:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791723.053721:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2352:x1875683606393600:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 39us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791723.053744:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 15 00000100:00100000:3.0:1788791723.053758:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:3.0:1788791723.053765:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab8deec1-d492-4ec8-be91-5e484d9b7641+5:2352:x1875683606394112:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791723.053792:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc147b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab8deec1-d492-4ec8-be91-5e484d9b7641+5:2352:x1875683606394112:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 28us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791723.053798:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 16 00000100:00100000:3.0:1788791723.053809:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:3.0:1788791723.053815:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2352:x1875683606393728:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791723.053836:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc146a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6788f146-04ff-4ba5-8299-9481a02c8bed+5:2352:x1875683606393728:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 22us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791723.053842:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 17 00000100:00100000:3.0:1788791723.053855:0:15043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:3.0:1788791723.053861:0:15043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababb910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab8deec1-d492-4ec8-be91-5e484d9b7641+5:2352:x1875683606393984:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791723.053880:0:15043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababb910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ab8deec1-d492-4ec8-be91-5e484d9b7641+5:2352:x1875683606393984:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 20us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791723.053886:0:15043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 18 00000100:00100000:3.0:1788791723.053902:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606393856 00000100:00100000:3.0:1788791723.053905:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606393856 00000100:00100000:3.0:1788791723.053931:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875683606393472 00000100:00100000:3.0:1788791723.053934:0:14362:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875683606393472 00000100:00100000:3.0:1788791723.053964:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:3.0:1788791723.053971:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9aba85781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2352:x1875683606393856:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791723.054003:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9aba85781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ab8deec1-d492-4ec8-be91-5e484d9b7641+6:2352:x1875683606393856:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 32us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791723.054016:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 28 00000100:00100000:3.0:1788791723.054030:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00100000:3.0:1788791723.054036:0:14362:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9ababc145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+20:2352:x1875683606393472:12345-192.168.201.29@tcp:400:kworker.0 00000100:00100000:3.0:1788791723.054066:0:14362:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9ababc145180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6788f146-04ff-4ba5-8299-9481a02c8bed+20:2352:x1875683606393472:12345-192.168.201.29@tcp:400:kworker.0 Request processed in 30us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788791723.054072:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.29@tcp, seq: 29 00000100:00080000:3.0:1788791723.054248:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788791723.054254:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788791723.054256:0:14357:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788791723.108871:0:14349:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788791724.132375:0:16035:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29216 lines, 29216 kept, 0 dropped, 0 bad.